Aug 25 06:44:03 devstack cinder-volume[83339]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 06:44:03 devstack cinder-volume[83339]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:44:03 devstack cinder-volume[83339]: we strongly recommend against using it for new projects. Aug 25 06:44:03 devstack cinder-volume[83339]: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:44:03 devstack cinder-volume[83339]: framework. For more detail see Aug 25 06:44:03 devstack cinder-volume[83339]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:44:03 devstack cinder-volume[83339]: import eventlet # noqa Aug 25 06:44:06 devstack cinder-volume[83339]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:44:06 devstack cinder-volume[83339]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:44:06 devstack cinder-volume[83339]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:44:07 devstack cinder-volume[83339]: INFO dbcounter [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Registered counter for database cinder Aug 25 06:44:07 devstack cinder-volume[83339]: DEBUG oslo_db.sqlalchemy.engines [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:44:08 devstack cinder-volume[83339]: DEBUG dbcounter [-] [83339] Writer thread running {{(pid=83339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:44:08 devstack cinder-volume[83339]: INFO cinder.rpc [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 06:44:08 devstack cinder-volume[83339]: INFO cinder.rpc [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 06:44:08 devstack cinder-volume[83339]: DEBUG oslo_db.sqlalchemy.engines [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:44:08 devstack cinder-volume[83339]: INFO cinder.volume.manager [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Determined volume DB was empty at startup. Aug 25 06:44:08 devstack cinder-volume[83339]: DEBUG cinder.volume.manager [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83339) __init__ /opt/stack/cinder/cinder/volume/manager.py:309}} Aug 25 06:44:08 devstack cinder-volume[83339]: INFO cinder.volume.manager [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 25 06:44:08 devstack cinder-volume[83339]: WARNING stevedore.named [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:44:08 devstack cinder-volume[83339]: WARNING castellan.key_manager [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:44:08 devstack cinder-volume[83339]: WARNING cinder.keymgr.conf_key_mgr [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:44:08 devstack cinder-volume[83339]: DEBUG cinder.volume.drivers.lvm [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83339) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 25 06:44:08 devstack cinder-volume[83339]: DEBUG oslo_concurrency.processutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_concurrency.processutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] CMD "cinder-rtstool verify" returned: 0 in 0.475s {{(pid=83339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_db.sqlalchemy.engines [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:44:09 devstack cinder-volume[83339]: INFO cinder.rpc [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 25 06:44:09 devstack cinder-volume[83339]: INFO cinder.rpc [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Aug 25 06:44:09 devstack cinder-volume[83339]: WARNING stevedore.named [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:44:09 devstack cinder-volume[83339]: WARNING castellan.key_manager [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:44:09 devstack cinder-volume[83339]: INFO cinder.volume.manager [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_db.sqlalchemy.engines [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:44:09 devstack cinder-volume[83339]: INFO oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Starting 1 workers Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Started child 83526 {{(pid=83339) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Full set of CONF: {{(pid=83339) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] ******************************************************************************** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Configuration options gathered from: {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] ================================================================================ {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] allow_availability_zone_fallback = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] allow_compression_on_image_upload = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] allowed_direct_url_schemes = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] api_rate_limit = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] auth_strategy = keystone {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] az_cache_duration = 3600 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_availability_zone = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_host = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_stats_polling_interval = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backup_api_class = cinder.backup.api.API {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backup_name_template = backup-%s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backup_use_same_host = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backup_use_temp_snapshot = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] chap_password = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] chap_username = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_internal_tenant_project_id = ccb1143e5e8440d8b37374320826c8f9 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_internal_tenant_user_id = 02310dac9a81422abcbd773d6cefd395 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cloned_volume_same_az = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cluster = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] compression_format = gzip {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] compute_api_class = cinder.compute.nova.API {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] config_dir = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] config_source = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] control_exchange = openstack {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] debug = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] default_availability_zone = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] default_group_type = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] default_volume_type = lvmdriver-1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] disk_geometry = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] driver_client_cert = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] driver_client_cert_key = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] driver_data_namespace = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] driver_ssl_cert_path = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] driver_ssl_cert_verify = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] driver_use_ssl = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] enable_force_upload = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83526]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] enable_new_services = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] enable_unsupported_driver = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] enabled_backends = ['lvmdriver-1'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] enforce_multipath_for_image_xfer = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] filter_function = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_api_insecure = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_api_ssl_compression = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_ca_certificates_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_catalog_info = image:glance:publicURL {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_num_retries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance_request_timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] goodness_function = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] graceful_shutdown_timeout = 5 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] group_api_class = cinder.group.api.API {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] host = devstack {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_compress_on_upload = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_conversion_address_space_limit = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_conversion_cpu_limit = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_conversion_disable = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_upload_use_cinder_backend = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_upload_use_internal_tenant = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_volume_cache_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_volume_cache_max_count = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] image_volume_cache_max_size_gb = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] init_host_max_objects_retrieval = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] instance_format = [instance: %(uuid)s] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] iscsi_target_flags = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] iscsi_write_cache = on {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] iser_helper = tgtadm {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] iser_ip_address = 192.168.122.71 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] iser_port = 3260 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_color = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_config_append = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_dir = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_options = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_rotate_interval = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_rotate_interval_type = days {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] log_rotation_type = none {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] max_age = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] max_logfile_count = 30 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] max_logfile_size_mb = 200 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] max_over_subscription_ratio = 20.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] message_reap_interval = 86400 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] message_ttl = 2592000 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] migration_create_volume_timeout_secs = 300 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] monkey_patch = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] monkey_patch_modules = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] my_ip = 192.168.122.71 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] no_snapshot_gb_quota = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] num_iser_scan_tries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] num_shell_tries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] num_volume_device_scan_tries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] nvmeof_conn_info_version = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] nvmet_ns_id = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] nvmet_port_id = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_max_limit = 1000 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_volume_ext_list = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_volume_listen_port = 8776 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_volume_use_ssl = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] osapi_volume_workers = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] per_volume_size_limit = -1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] periodic_fuzzy_delay = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] periodic_interval = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] public_endpoint = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] publish_errors = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_backup_gigabytes = 1000 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_backups = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_gigabytes = 1000 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_groups = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_snapshots = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] quota_volumes = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] rate_limit_burst = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] rate_limit_except_level = CRITICAL {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] rate_limit_interval = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] reinit_driver_count = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] replication_device = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] replication_encryption_keys = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] report_discard_supported = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] report_interval = 120 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] reservation_clean_interval = 86400 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] reservation_expire = 86400 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] reserved_image_namespaces = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] reserved_percentage = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] rpc_response_timeout = 120 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] run_external_periodic_tasks = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] scst_target_driver = iscsi {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] scst_target_iqn_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_down_time = 720 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] shell_completion = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] snapshot_name_template = snapshot-%s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] snapshot_same_host = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] split_loggers = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] state_path = /opt/stack/data/cinder {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] storage_availability_zone = nova {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] storage_protocol = iSCSI {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] syslog_log_facility = LOG_USER {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] target_helper = lioadm {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] target_ip_address = 192.168.122.71 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] target_port = 3260 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] target_protocol = iscsi {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] target_secondary_ip_addresses = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] trace_flags = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] transport_url = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] until_refresh = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_chap_auth = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_default_quota_class = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_journal = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_json = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_multipath_for_image_xfer = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_stderr = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] use_syslog = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] verify_glance_signatures = enabled {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_api_class = cinder.volume.api.API {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_backend_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_clear = zero {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_clear_ionice = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_clear_size = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_copy_bps_limit = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_dd_blocksize = 1M {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_name_template = volume-%s {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_service_inithost_offload = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volume_usage_audit_period = month {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] zoning_mode = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_concurrency.disable_process_locking = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.auth_section = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.auth_type = password {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.auth_version = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.cache = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.include_service_catalog = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.insecure = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.interface = public {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_password = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcache_username = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.region_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.service_token_roles_required = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.service_type = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.backend = dogpile.cache.null {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.backend_argument = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.backend_expiration_time = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.config_prefix = cache.oslo {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.debug_cache_backend = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.enable_retry_client = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.enable_socket_keepalive = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.expiration_time = 600 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.hashclient_retry_attempts = 2 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_dead_retry = 300 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_pool_maxsize = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_sasl_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.password = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.proxies = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.redis_db = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.redis_server = localhost:6379 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.retry_attempts = 2 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.retry_delay = 0.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.socket_keepalive_count = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.socket_keepalive_idle = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.socket_keepalive_interval = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.socket_timeout = 1.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.tls_allowed_ciphers = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.tls_cafile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.tls_certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.tls_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.tls_keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cache.username = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] coordination.backend_url = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.asyncio_connection = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.asyncio_slave_connection = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.backend = sqlalchemy {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.connection = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.connection_debug = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.connection_parameters = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.connection_recycle_time = 3600 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.connection_trace = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.db_inc_retry_interval = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.db_max_retries = 20 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.db_max_retry_interval = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.db_retry_interval = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.max_overflow = 50 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.max_pool_size = 5 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.max_retries = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.mysql_wsrep_sync_wait = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.pool_timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.retry_interval = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.slave_connection = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.sqlite_synchronous = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83526]: INFO cinder.volume.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.synchronous_reader = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] database.use_db_reconnect = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.connection_string = messaging:// {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.es_doc_type = notification {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.es_scroll_size = 10000 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.es_scroll_time = 2m {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.filter_error_trace = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.hmac_keys = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.sentinel_service_name = mymaster {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.socket_timeout = 0.1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.trace_requests = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler.trace_sqlalchemy = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler_jaeger.process_tags = {} {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler_jaeger.service_name_prefix = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] profiler_otlp.service_name_prefix = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.enforce_new_defaults = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.policy_default_rule = default {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.policy_file = policy.yaml {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.group = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.helper_command = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] privsep_osbrick.user = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.group = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.helper_command = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] cinder_sys_admin.user = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.auth_section = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.auth_type = password {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.cafile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.collect_timing = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.insecure = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.send_service_user_token = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.split_loggers = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] service_user.timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.auth_section = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.auth_type = password {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.collect_timing = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.insecure = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.region_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.split_loggers = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] glance.timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.backend_availability_zone = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.chap_password = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.chap_username = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.disk_geometry = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.driver_client_cert = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.driver_client_cert_key = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.driver_data_namespace = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.driver_use_ssl = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.extra_capabilities = {} {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.filter_function = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.goodness_function = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.iscsi_target_flags = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.iscsi_write_cache = on {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.iser_helper = tgtadm {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.iser_port = 3260 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.lvm_mirrors = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.lvm_share_target = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.lvm_type = auto {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.num_shell_tries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.replication_device = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.replication_encryption_keys = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.report_discard_supported = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.reserved_percentage = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.target_helper = tgtadm {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.target_port = 3260 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.target_protocol = iscsi {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.trace_flags = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.unique_fqdn_network = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.use_chap_auth = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_backend_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_clear = zero {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_clear_ionice = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_clear_size = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volume_group = cinder-volumes {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_reports.file_event_handler = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_reports.log_dir = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.backend_availability_zone = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.backend_host = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.chap_password = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.chap_username = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.chiscsi_conf = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.disk_geometry = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.driver_client_cert = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.driver_data_namespace = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.driver_use_ssl = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.extra_capabilities = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.filter_function = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.goodness_function = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.069s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.iser_helper = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.iser_ip_address = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.iser_port = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.iser_target_prefix = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.lvm_conf_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.lvm_mirrors = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.lvm_share_target = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.lvm_type = auto {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.num_shell_tries = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.nvmet_port_id = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.replication_device = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.replication_encryption_keys = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.report_discard_supported = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.reserved_percentage = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.scst_target_driver = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.storage_protocol = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.target_helper = lioadm {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.target_ip_address = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.target_port = 3260 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.target_protocol = iscsi {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.trace_flags = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.use_chap_auth = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_clear = zero {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_clear_size = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] lvmdriver-1.volumes_dir = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_notifications.driver = [] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_notifications.retry = -1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] key_manager.fixed_key = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.barbican_api_version = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.barbican_endpoint = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.barbican_endpoint_type = public {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.barbican_region_name = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.cafile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.collect_timing = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.insecure = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.number_of_retries = 60 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.retry_delay = 1 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.send_service_user_token = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.split_loggers = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.verify_ssl = True {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican.verify_ssl_path = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.auth_section = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.auth_type = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.cafile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.certfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.collect_timing = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.insecure = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.keyfile = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.split_loggers = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] barbican_service_user.timeout = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.approle_role_id = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.approle_secret_id = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.auth_method = approle {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.auth_path = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.kv_mountpoint = secret {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.kv_path = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.kv_version = 2 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.namespace = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.root_token_id = **** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.ssl_ca_crt_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.timeout = 60.0 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.token_file = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.token_role = None {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.use_ssl = False {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:44:09 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] ******************************************************************************** {{(pid=83339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:09 devstack sudo[83530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 25 06:44:09 devstack sudo[83530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:09 devstack sudo[83530]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:09 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:09 devstack sudo[83644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:09 devstack sudo[83644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:10 devstack sudo[83644]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.297s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:44:10 devstack cinder-volume[83526]: INFO cinder.brick.local_dev.lvm [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:10 devstack sudo[83758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:44:10 devstack sudo[83758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:10 devstack sudo[83758]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG cinder.brick.local_dev.lvm [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83526) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:10 devstack sudo[83838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:10 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:10 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:10 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:10 devstack sudo[84020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:10 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:11 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:11 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 25 06:44:11 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:11 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.267s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:11 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:44:11 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:11 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:11 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:11 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:44:11 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:12 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:12 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:12 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:12 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:12 devstack sudo[84299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:12 devstack sudo[84299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:12 devstack sudo[84299]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:12 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:12 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:12 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:13 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:13 devstack cinder-volume[83526]: INFO cinder.volume.drivers.lvm [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:13 devstack sudo[84331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:13 devstack sudo[84331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:13 devstack sudo[84331]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG cinder.volume.drivers.lvm [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Updating volume stats {{(pid=83526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:13 devstack sudo[84334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:44:13 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:13 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:13 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:13 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:13 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:13 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:13 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:13 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:14 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:14 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:14 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:14 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:14 devstack cinder-volume[83526]: INFO cinder.volume.driver [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Driver hasn't implemented _init_vendor_properties() Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG cinder.volume.driver [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83526) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_db.sqlalchemy.engines [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG dbcounter [-] [83526] Writer thread running {{(pid=83526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG cinder.db.api [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Building query based on filter {{(pid=83526) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG cinder.image.image_utils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83526) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 06:44:14 devstack cinder-volume[83526]: INFO cinder.keymgr.migration [None req-294aa958-a681-4a7d-935a-3e7012f0aa40 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG cinder.volume.drivers.lvm [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Updating volume stats {{(pid=83526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:14 devstack sudo[84346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:44:14 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:14 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:14 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:14 devstack sudo[84351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:14 devstack sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:15 devstack sudo[84351]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:15 devstack sudo[84355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:15 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:15 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:15 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:15 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:15 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG cinder.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Notifying Schedulers of capabilities ... {{(pid=83526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:44:15 devstack cinder-volume[83526]: INFO cinder.volume.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Driver initialization completed successfully. Aug 25 06:44:15 devstack cinder-volume[83526]: INFO cinder.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Initiating service 2 cleanup Aug 25 06:44:15 devstack cinder-volume[83526]: INFO cinder.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Service 2 cleanup completed. Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG cinder.service [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Creating RPC server for service cinder-volume {{(pid=83526) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG cinder.service [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83526) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 06:44:15 devstack cinder-volume[83526]: INFO cinder.volume.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG cinder.volume.drivers.lvm [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Updating volume stats {{(pid=83526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:15 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:44:15 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:15 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:15 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:16 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:16 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:16 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:16 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:16 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:16 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:44:16 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:16 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:16 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:16 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:44:16 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:44:16 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:44:16 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Aug 25 06:44:16 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:44:16 devstack cinder-volume[83526]: INFO cinder.volume.manager [None req-94c4179e-12aa-44a4-b6b5-ec0f12197e48 None None] Driver post RPC initialization completed successfully. Aug 25 06:44:19 devstack cinder-volume[83339]: DEBUG dbcounter [-] [83339] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:44:26 devstack cinder-volume[83526]: DEBUG dbcounter [-] [83526] Writing DB stats cinder:SELECT=4 {{(pid=83526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:44:26 devstack cinder-volume[83526]: DEBUG dbcounter [-] [83526] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:44:40 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager._thread_info {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:44:40 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread count: 6 {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:44:40 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread info: [<_MainThread(MainThread, started 132770219114624)>, , , , , ] {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:45:40 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:45:40 devstack cinder-volume[83526]: DEBUG cinder.volume.drivers.lvm [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Updating volume stats {{(pid=83526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:45:40 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:40 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:45:40 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:41 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:41 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:45:41 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:41 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:41 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:45:41 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:41 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:45:41 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:45:41 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:45:41 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG cinder.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Notifying Schedulers of capabilities ... {{(pid=83526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager._thread_info {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread count: 6 {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:45:41 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread info: [<_MainThread(MainThread, started 132770219114624)>, , , , , ] {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:46:26 devstack cinder-volume[83526]: DEBUG dbcounter [-] [83526] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:46:40 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:46:40 devstack cinder-volume[83526]: DEBUG cinder.volume.drivers.lvm [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Updating volume stats {{(pid=83526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:46:40 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:40 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:46:40 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:41 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:41 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:46:41 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:41 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:41 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:46:41 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:41 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:46:41 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:46:41 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:46:41 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG cinder.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Notifying Schedulers of capabilities ... {{(pid=83526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager._thread_info {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread count: 6 {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:46:41 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread info: [<_MainThread(MainThread, started 132770219114624)>, , , , , ] {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:47:40 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:47:40 devstack cinder-volume[83526]: DEBUG cinder.volume.drivers.lvm [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Updating volume stats {{(pid=83526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 06:47:40 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:40 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 06:47:40 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:41 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:41 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:47:41 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:41 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:41 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 06:47:41 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:41 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:47:41 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 06:47:41 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:47:41 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_concurrency.processutils [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG cinder.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Notifying Schedulers of capabilities ... {{(pid=83526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG oslo_service.periodic_task [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] Running periodic task VolumeManager._thread_info {{(pid=83526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread count: 6 {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:47:41 devstack cinder-volume[83526]: DEBUG cinder.volume.manager [None req-8a21202e-c0d7-44af-a06c-add139cec006 None None] thread info: [<_MainThread(MainThread, started 132770219114624)>, , , , , ] {{(pid=83526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:48:26 devstack cinder-volume[83526]: DEBUG dbcounter [-] [83526] Writing DB stats cinder:SELECT=1 {{(pid=83526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:48:26 devstack cinder-volume[83526]: DEBUG dbcounter [-] [83526] Writing DB stats cinder:UPDATE=1 {{(pid=83526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:48:40 devstack cinder-volume[83339]: INFO oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Caught SIGTERM, stopping children Aug 25 06:48:40 devstack cinder-volume[83339]: DEBUG oslo_concurrency.lockutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Acquiring lock "singleton_lock" {{(pid=83339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:40 devstack cinder-volume[83339]: DEBUG oslo_concurrency.lockutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Acquired lock "singleton_lock" {{(pid=83339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:40 devstack cinder-volume[83339]: DEBUG oslo_concurrency.lockutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Releasing lock "singleton_lock" {{(pid=83339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:40 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Stop services. {{(pid=83339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 25 06:48:40 devstack cinder-volume[83339]: DEBUG oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Killing children. {{(pid=83339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 25 06:48:40 devstack cinder-volume[83339]: INFO oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Waiting on 1 children to exit Aug 25 06:48:40 devstack cinder-volume[83526]: DEBUG oslo_concurrency.lockutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Acquiring lock "singleton_lock" {{(pid=83526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:40 devstack cinder-volume[83526]: DEBUG oslo_concurrency.lockutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Acquired lock "singleton_lock" {{(pid=83526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:40 devstack cinder-volume[83526]: DEBUG oslo_concurrency.lockutils [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Releasing lock "singleton_lock" {{(pid=83526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:40 devstack cinder-volume[83526]: WARNING amqp [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:40 devstack cinder-volume[83526]: WARNING amqp [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:40 devstack cinder-volume[83339]: INFO oslo_service.backend._eventlet.service [None req-b178a9f8-483a-470c-8e25-44890c602f5c None None] Child 83526 exited with status 0 Aug 25 06:48:41 devstack cinder-volume[93661]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 06:48:41 devstack cinder-volume[93661]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:48:41 devstack cinder-volume[93661]: we strongly recommend against using it for new projects. Aug 25 06:48:41 devstack cinder-volume[93661]: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:48:41 devstack cinder-volume[93661]: framework. For more detail see Aug 25 06:48:41 devstack cinder-volume[93661]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:48:41 devstack cinder-volume[93661]: import eventlet # noqa Aug 25 06:48:43 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:43 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:43 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:43 devstack cinder-volume[93661]: INFO dbcounter [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Registered counter for database cinder Aug 25 06:48:43 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG dbcounter [-] [93661] Writer thread running {{(pid=93661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:44 devstack cinder-volume[93661]: INFO cinder.rpc [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 06:48:44 devstack cinder-volume[93661]: INFO cinder.rpc [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:44 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Determined volume DB was empty at startup. Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG cinder.volume.manager [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93661) __init__ /opt/stack/cinder/cinder/volume/manager.py:309}} Aug 25 06:48:44 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 25 06:48:44 devstack cinder-volume[93661]: WARNING stevedore.named [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:48:44 devstack cinder-volume[93661]: WARNING castellan.key_manager [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:44 devstack cinder-volume[93661]: WARNING cinder.keymgr.conf_key_mgr [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:44 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:44 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Starting 1 workers Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Started child 93876 {{(pid=93661) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Full set of CONF: {{(pid=93661) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] ******************************************************************************** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Configuration options gathered from: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] ================================================================================ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 06:48:44 devstack cinder-volume[93876]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] allow_availability_zone_fallback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] allow_compression_on_image_upload = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] allowed_direct_url_schemes = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] api_rate_limit = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] auth_strategy = keystone {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_host = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_stats_polling_interval = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backup_api_class = cinder.backup.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backup_name_template = backup-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backup_use_same_host = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backup_use_temp_snapshot = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] chap_username = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_internal_tenant_project_id = ccb1143e5e8440d8b37374320826c8f9 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_internal_tenant_user_id = 02310dac9a81422abcbd773d6cefd395 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cluster = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] compression_format = gzip {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] compute_api_class = cinder.compute.nova.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] config_dir = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] config_source = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] control_exchange = openstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] debug = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] default_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] default_group_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] default_volume_type = QuobyteHD {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] driver_ssl_cert_verify = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] driver_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] enable_new_services = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] enable_unsupported_driver = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] enabled_backends = ['QuobyteHD'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] enforce_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_api_insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_api_ssl_compression = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_ca_certificates_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_catalog_info = image:glance:publicURL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_num_retries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance_request_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] graceful_shutdown_timeout = 5 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] group_api_class = cinder.group.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] host = devstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_compress_on_upload = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_conversion_address_space_limit = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_conversion_cpu_limit = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_conversion_disable = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_upload_use_cinder_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_upload_use_internal_tenant = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_volume_cache_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_volume_cache_max_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] image_volume_cache_max_size_gb = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] init_host_max_objects_retrieval = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] instance_format = [instance: %(uuid)s] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] iscsi_target_flags = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Starting volume driver QuobyteDriver (1.2) Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.remotefs [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93876) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] iscsi_write_cache = on {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] iser_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] iser_ip_address = 192.168.122.71 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] iser_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_color = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_config_append = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_dir = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_options = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_rotate_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_rotate_interval_type = days {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] log_rotation_type = none {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] max_age = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] max_logfile_count = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] max_logfile_size_mb = 200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] max_over_subscription_ratio = 20.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] message_reap_interval = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] message_ttl = 2592000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] migration_create_volume_timeout_secs = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] monkey_patch = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] monkey_patch_modules = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] my_ip = 192.168.122.71 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] no_snapshot_gb_quota = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] num_iser_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] num_shell_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] num_volume_device_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] nvmeof_conn_info_version = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] nvmet_ns_id = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] nvmet_port_id = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_max_limit = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_volume_ext_list = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_volume_listen_port = 8776 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_volume_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] osapi_volume_workers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] per_volume_size_limit = -1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] periodic_fuzzy_delay = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] periodic_interval = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] public_endpoint = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] publish_errors = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_backup_gigabytes = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_backups = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_gigabytes = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_groups = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_snapshots = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] quota_volumes = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] rate_limit_burst = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] rate_limit_except_level = CRITICAL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] rate_limit_interval = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] reinit_driver_count = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] replication_encryption_keys = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] report_discard_supported = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] report_interval = 120 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] reservation_clean_interval = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] reservation_expire = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] reserved_image_namespaces = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] reserved_percentage = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] rpc_response_timeout = 120 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] run_external_periodic_tasks = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] scst_target_driver = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_down_time = 720 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] shell_completion = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] snapshot_name_template = snapshot-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] state_path = /opt/stack/data/cinder {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] storage_availability_zone = nova {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] storage_protocol = iSCSI {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] syslog_log_facility = LOG_USER {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] target_helper = lioadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] target_ip_address = 192.168.122.71 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] target_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] target_protocol = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] target_secondary_ip_addresses = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] trace_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] transport_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] until_refresh = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_chap_auth = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_default_quota_class = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_journal = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_json = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_stderr = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] use_syslog = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] verify_glance_signatures = enabled {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_api_class = cinder.volume.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_clear = zero {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_clear_size = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_copy_bps_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_dd_blocksize = 1M {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_name_template = volume-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_service_inithost_offload = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volume_usage_audit_period = month {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] zoning_mode = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_concurrency.disable_process_locking = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.auth_type = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.auth_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.include_service_catalog = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.interface = public {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_password = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcache_username = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93876) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 25 06:48:44 devstack cinder-volume[93876]: WARNING cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 25 06:48:44 devstack cinder-volume[93876]: WARNING cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Running cmd (subprocess): mount.quobyte {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.service_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.backend = dogpile.cache.null {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.backend_argument = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.backend_expiration_time = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.config_prefix = cache.oslo {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.debug_cache_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.enable_retry_client = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.enable_socket_keepalive = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.expiration_time = 600 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.hashclient_retry_attempts = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_dead_retry = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_sasl_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.proxies = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.redis_db = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.redis_server = localhost:6379 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.retry_attempts = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.retry_delay = 0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.socket_keepalive_count = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.socket_keepalive_idle = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.socket_keepalive_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.socket_timeout = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.tls_allowed_ciphers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.tls_cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.tls_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.tls_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.tls_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cache.username = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] coordination.backend_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.asyncio_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.asyncio_slave_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.backend = sqlalchemy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.connection_debug = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.connection_parameters = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.connection_recycle_time = 3600 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.connection_trace = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.db_inc_retry_interval = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.db_max_retries = 20 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.db_max_retry_interval = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.db_retry_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.max_overflow = 50 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.max_pool_size = 5 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.max_retries = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.mysql_wsrep_sync_wait = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.pool_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.retry_interval = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.slave_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.sqlite_synchronous = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.synchronous_reader = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] database.use_db_reconnect = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.connection_string = messaging:// {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.es_doc_type = notification {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.es_scroll_size = 10000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.es_scroll_time = 2m {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.filter_error_trace = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.hmac_keys = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.sentinel_service_name = mymaster {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.socket_timeout = 0.1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.trace_requests = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler.trace_sqlalchemy = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler_jaeger.process_tags = {} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler_jaeger.service_name_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] profiler_otlp.service_name_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.enforce_new_defaults = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.policy_default_rule = default {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.policy_file = policy.yaml {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.group = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.helper_command = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] privsep_osbrick.user = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.group = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.helper_command = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] cinder_sys_admin.user = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.auth_type = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.send_service_user_token = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] service_user.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.auth_type = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] glance.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.chap_username = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.driver_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.extra_capabilities = {} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.iscsi_target_flags = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.iscsi_write_cache = on {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.iser_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.iser_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_host = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_login = admin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_mount_options = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_private_key = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_share_path = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack quobyte-client[93881]: Reading configuration file: /etc/quobyte/client.cfg Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.num_shell_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack quobyte-client[93881]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.quobyte_volume_url = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.replication_encryption_keys = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.report_discard_supported = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.reserved_percentage = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.target_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.target_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.target_protocol = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.trace_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.unique_fqdn_network = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.use_chap_auth = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: INFO cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b ... Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_clear = zero {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f -c /etc/quobyte/client-cinder.cfg {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_clear_size = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_reports.file_event_handler = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_reports.log_dir = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.backend_host = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.chap_username = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.chiscsi_conf = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.driver_use_ssl = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.extra_capabilities = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.iser_helper = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.iser_ip_address = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.iser_port = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.iser_target_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f -c /etc/quobyte/client-cinder.cfg Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_host = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_login = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_mount_options = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_private_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_share_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_ssh_port = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.num_shell_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.nvmet_port_id = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.replication_encryption_keys = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.report_discard_supported = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.reserved_percentage = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.scst_target_driver = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.storage_protocol = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.target_helper = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.target_ip_address = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.target_port = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.target_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.target_protocol = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.trace_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.use_chap_auth = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_clear = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_clear_size = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] QuobyteHD.volumes_dir = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_notifications.driver = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_notifications.retry = -1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] key_manager.fixed_key = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.barbican_api_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.barbican_endpoint = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.barbican_endpoint_type = public {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.barbican_region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.number_of_retries = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.retry_delay = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.send_service_user_token = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.verify_ssl = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican.verify_ssl_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.auth_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] barbican_service_user.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.approle_role_id = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.approle_secret_id = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.auth_method = approle {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.auth_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.kv_mountpoint = secret {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.kv_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.kv_version = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.root_token_id = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.ssl_ca_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.timeout = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.token_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.token_role = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:44 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] ******************************************************************************** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 06:48:45 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.390s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:45 devstack cinder-volume[93876]: INFO cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b succeeded Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:45 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:48:45 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:45 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.257s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:45 devstack cinder-volume[93876]: INFO cinder.volume.driver [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Driver hasn't implemented _init_vendor_properties() Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.volume.driver [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93876) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_db.sqlalchemy.engines [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG dbcounter [-] [93876] Writer thread running {{(pid=93876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.db.api [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Building query based on filter {{(pid=93876) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.image.image_utils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93876) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 06:48:45 devstack cinder-volume[93876]: INFO cinder.keymgr.migration [None req-5d0f60f5-7e7a-46cc-bb10-0104054ff2d1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:45 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:48:45 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:45 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.229s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Notifying Schedulers of capabilities ... {{(pid=93876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:48:45 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Driver initialization completed successfully. Aug 25 06:48:45 devstack cinder-volume[93876]: INFO cinder.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Initiating service 3 cleanup Aug 25 06:48:45 devstack cinder-volume[93876]: INFO cinder.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Service 3 cleanup completed. Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.service [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Creating RPC server for service cinder-volume {{(pid=93876) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 06:48:45 devstack cinder-volume[93876]: DEBUG cinder.service [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93876) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 06:48:46 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:46 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:48:46 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:46 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:46 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.293s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:46 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-92cfa31e-79db-426b-80d1-9867a643f123 None None] Driver post RPC initialization completed successfully. Aug 25 06:48:50 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:50 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:50 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:50 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:50 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:50 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:50 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:48:50 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:51 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Aug 25 06:48:51 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.236s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:51 devstack cinder-volume[93876]: DEBUG cinder.manager [None req-aa6a2c35-b32c-4040-a159-d1d1e12a9213 None None] Notifying Schedulers of capabilities ... {{(pid=93876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:48:51 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Caught SIGTERM, stopping children Aug 25 06:48:51 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Acquiring lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:51 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Acquired lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:51 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Releasing lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Stop services. {{(pid=93661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 25 06:48:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Killing children. {{(pid=93661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 25 06:48:51 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Waiting on 1 children to exit Aug 25 06:48:54 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Acquiring lock "singleton_lock" {{(pid=93876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:54 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Acquired lock "singleton_lock" {{(pid=93876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:54 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Releasing lock "singleton_lock" {{(pid=93876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:54 devstack cinder-volume[93876]: WARNING amqp [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:54 devstack cinder-volume[93876]: WARNING amqp [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 25 06:48:54 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-b0b821f9-3436-425c-930d-bd1d0997a757 None None] Child 93876 exited with status 0 Aug 25 06:48:54 devstack cinder-volume[94162]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 06:48:54 devstack cinder-volume[94162]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:48:54 devstack cinder-volume[94162]: we strongly recommend against using it for new projects. Aug 25 06:48:54 devstack cinder-volume[94162]: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:48:54 devstack cinder-volume[94162]: framework. For more detail see Aug 25 06:48:54 devstack cinder-volume[94162]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:48:54 devstack cinder-volume[94162]: import eventlet # noqa Aug 25 06:48:58 devstack cinder-volume[94162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 06:48:58 devstack cinder-volume[94162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 06:48:58 devstack cinder-volume[94162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 06:48:58 devstack cinder-volume[94162]: INFO dbcounter [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Registered counter for database cinder Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_db.sqlalchemy.engines [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG dbcounter [-] [94162] Writer thread running {{(pid=94162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:48:59 devstack cinder-volume[94162]: INFO cinder.rpc [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 06:48:59 devstack cinder-volume[94162]: INFO cinder.rpc [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_db.sqlalchemy.engines [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:59 devstack cinder-volume[94162]: INFO cinder.volume.manager [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Determined volume DB was empty at startup. Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG cinder.volume.manager [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94162) __init__ /opt/stack/cinder/cinder/volume/manager.py:309}} Aug 25 06:48:59 devstack cinder-volume[94162]: WARNING stevedore.named [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 06:48:59 devstack cinder-volume[94162]: WARNING castellan.key_manager [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:59 devstack cinder-volume[94162]: WARNING cinder.keymgr.conf_key_mgr [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 06:48:59 devstack cinder-volume[94162]: INFO cinder.volume.manager [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_db.sqlalchemy.engines [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:48:59 devstack cinder-volume[94162]: INFO oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Starting 1 workers Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Started child 94460 {{(pid=94162) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Full set of CONF: {{(pid=94162) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] ******************************************************************************** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] Configuration options gathered from: {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] ================================================================================ {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 06:48:59 devstack cinder-volume[94460]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] allow_availability_zone_fallback = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] allow_compression_on_image_upload = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] allowed_direct_url_schemes = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] api_rate_limit = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] auth_strategy = keystone {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_availability_zone = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_host = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_stats_polling_interval = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backup_api_class = cinder.backup.api.API {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backup_name_template = backup-%s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backup_use_same_host = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backup_use_temp_snapshot = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] chap_password = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] chap_username = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_internal_tenant_project_id = ccb1143e5e8440d8b37374320826c8f9 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_internal_tenant_user_id = 02310dac9a81422abcbd773d6cefd395 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cluster = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] compression_format = gzip {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] compute_api_class = cinder.compute.nova.API {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] config_dir = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] config_source = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] control_exchange = openstack {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] debug = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] default_availability_zone = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] default_group_type = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] default_volume_type = QuobyteHD {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] disk_geometry = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] driver_client_cert = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] driver_client_cert_key = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] driver_data_namespace = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] driver_ssl_cert_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] driver_ssl_cert_verify = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] driver_use_ssl = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] enable_new_services = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] enable_unsupported_driver = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] enabled_backends = ['QuobyteHD'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] enforce_multipath_for_image_xfer = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] filter_function = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_api_insecure = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_api_ssl_compression = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_ca_certificates_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_catalog_info = image:glance:publicURL {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_num_retries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance_request_timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] goodness_function = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] graceful_shutdown_timeout = 5 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] group_api_class = cinder.group.api.API {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] host = devstack {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_compress_on_upload = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_conversion_address_space_limit = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_conversion_cpu_limit = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_conversion_disable = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_upload_use_cinder_backend = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_upload_use_internal_tenant = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_volume_cache_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_volume_cache_max_count = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] image_volume_cache_max_size_gb = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] init_host_max_objects_retrieval = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] instance_format = [instance: %(uuid)s] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] iscsi_target_flags = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] iscsi_write_cache = on {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] iser_helper = tgtadm {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] iser_ip_address = 192.168.122.71 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] iser_port = 3260 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_color = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_config_append = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_dir = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_options = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_rotate_interval = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_rotate_interval_type = days {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] log_rotation_type = none {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] max_age = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] max_logfile_count = 30 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] max_logfile_size_mb = 200 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] max_over_subscription_ratio = 20.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] message_reap_interval = 86400 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] message_ttl = 2592000 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] migration_create_volume_timeout_secs = 300 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] monkey_patch = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] monkey_patch_modules = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] my_ip = 192.168.122.71 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Starting volume driver QuobyteDriver (1.2) Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] no_snapshot_gb_quota = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94460) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] num_iser_scan_tries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] num_shell_tries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] num_volume_device_scan_tries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] nvmeof_conn_info_version = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] nvmet_ns_id = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] nvmet_port_id = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_max_limit = 1000 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_volume_ext_list = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_volume_listen_port = 8776 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_volume_use_ssl = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] osapi_volume_workers = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] per_volume_size_limit = -1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] periodic_fuzzy_delay = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] periodic_interval = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] public_endpoint = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] publish_errors = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_backup_gigabytes = 1000 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_backups = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_gigabytes = 1000 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_groups = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_snapshots = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] quota_volumes = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] rate_limit_burst = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] rate_limit_except_level = CRITICAL {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] rate_limit_interval = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] reinit_driver_count = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] replication_device = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] replication_encryption_keys = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] report_discard_supported = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] report_interval = 120 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] reservation_clean_interval = 86400 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] reservation_expire = 86400 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] reserved_image_namespaces = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] reserved_percentage = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] rpc_response_timeout = 120 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] run_external_periodic_tasks = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] scst_target_driver = iscsi {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] scst_target_iqn_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_down_time = 720 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] shell_completion = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] snapshot_name_template = snapshot-%s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] split_loggers = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] state_path = /opt/stack/data/cinder {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] storage_availability_zone = nova {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] storage_protocol = iSCSI {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] syslog_log_facility = LOG_USER {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] target_helper = lioadm {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] target_ip_address = 192.168.122.71 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] target_port = 3260 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] target_protocol = iscsi {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] target_secondary_ip_addresses = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] trace_flags = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] transport_url = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] until_refresh = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_chap_auth = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_default_quota_class = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_journal = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_json = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_multipath_for_image_xfer = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_stderr = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] use_syslog = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] verify_glance_signatures = enabled {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_api_class = cinder.volume.api.API {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_backend_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_clear = zero {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_clear_ionice = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_clear_size = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_copy_bps_limit = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_dd_blocksize = 1M {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_name_template = volume-%s {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_service_inithost_offload = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volume_usage_audit_period = month {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] zoning_mode = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_concurrency.disable_process_locking = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.auth_section = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.auth_type = password {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.auth_version = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.cache = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.include_service_catalog = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.insecure = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.interface = public {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_password = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcache_username = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.region_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.service_type = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94460) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 25 06:48:59 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 25 06:48:59 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.backend = dogpile.cache.null {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.backend_argument = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.backend_expiration_time = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.config_prefix = cache.oslo {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.debug_cache_backend = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Running cmd (subprocess): mount.quobyte {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.enable_retry_client = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.enable_socket_keepalive = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.expiration_time = 600 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.hashclient_retry_attempts = 2 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_dead_retry = 300 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_pool_maxsize = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_sasl_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.password = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.proxies = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.redis_db = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.redis_server = localhost:6379 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.retry_attempts = 2 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.retry_delay = 0.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.socket_keepalive_count = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.socket_keepalive_idle = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.socket_keepalive_interval = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.socket_timeout = 1.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.tls_allowed_ciphers = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.tls_cafile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.tls_certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.tls_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.tls_keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cache.username = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] coordination.backend_url = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.asyncio_connection = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.asyncio_slave_connection = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.backend = sqlalchemy {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.connection = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.connection_debug = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.connection_parameters = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.connection_recycle_time = 3600 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.connection_trace = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.db_inc_retry_interval = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.db_max_retries = 20 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.db_max_retry_interval = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.db_retry_interval = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.max_overflow = 50 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.max_pool_size = 5 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.max_retries = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.mysql_wsrep_sync_wait = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.pool_timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.retry_interval = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.slave_connection = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.sqlite_synchronous = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.synchronous_reader = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] database.use_db_reconnect = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.connection_string = messaging:// {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.es_doc_type = notification {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.es_scroll_size = 10000 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.es_scroll_time = 2m {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.filter_error_trace = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.hmac_keys = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.sentinel_service_name = mymaster {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.socket_timeout = 0.1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.trace_requests = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler.trace_sqlalchemy = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler_jaeger.process_tags = {} {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler_jaeger.service_name_prefix = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] profiler_otlp.service_name_prefix = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.enforce_new_defaults = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.policy_default_rule = default {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.policy_file = policy.yaml {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack quobyte-client[94469]: Reading configuration file: /etc/quobyte/client.cfg Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.group = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.helper_command = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack quobyte-client[94469]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] privsep_osbrick.user = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.group = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.helper_command = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] cinder_sys_admin.user = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.auth_section = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.auth_type = password {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.cafile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.collect_timing = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.insecure = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.send_service_user_token = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.split_loggers = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] service_user.timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.auth_section = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.auth_type = password {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.collect_timing = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.insecure = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.region_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.split_loggers = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] glance.timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.backend_availability_zone = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.chap_password = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.chap_username = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.disk_geometry = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.driver_client_cert = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.driver_client_cert_key = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.driver_data_namespace = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.driver_use_ssl = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.extra_capabilities = {} {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.filter_function = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.goodness_function = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.iscsi_target_flags = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.iscsi_write_cache = on {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.iser_helper = tgtadm {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.iser_port = 3260 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_host = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_login = admin {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_mount_options = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_password = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_private_key = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_share_path = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.num_shell_tries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.quobyte_volume_url = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.replication_device = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.replication_encryption_keys = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.report_discard_supported = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.reserved_percentage = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:48:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.target_helper = tgtadm {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.target_port = 3260 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.target_protocol = iscsi {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.trace_flags = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.unique_fqdn_network = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.use_chap_auth = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_backend_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_clear = zero {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_clear_ionice = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_clear_size = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_reports.file_event_handler = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_reports.log_dir = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.backend_availability_zone = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.backend_host = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.chap_password = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.chap_username = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.chiscsi_conf = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.disk_geometry = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.driver_client_cert = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.driver_data_namespace = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.driver_use_ssl = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.extra_capabilities = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.filter_function = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.goodness_function = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.iser_helper = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.iser_ip_address = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.iser_port = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.iser_target_prefix = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_host = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_login = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_mount_options = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_password = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_private_key = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_share_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_ssh_port = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.num_shell_tries = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:48:59 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.nvmet_port_id = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.replication_device = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.replication_encryption_keys = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.report_discard_supported = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.reserved_percentage = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.scst_target_driver = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.storage_protocol = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.target_helper = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.target_ip_address = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.target_port = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.target_prefix = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.target_protocol = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.trace_flags = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.use_chap_auth = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_clear = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_clear_size = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] QuobyteHD.volumes_dir = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_notifications.driver = [] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_notifications.retry = -1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] key_manager.fixed_key = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.barbican_api_version = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.barbican_endpoint = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.barbican_endpoint_type = public {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.barbican_region_name = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.cafile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.collect_timing = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.insecure = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.number_of_retries = 60 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.retry_delay = 1 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.send_service_user_token = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.split_loggers = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.verify_ssl = True {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican.verify_ssl_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.auth_section = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.auth_type = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.cafile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.certfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.collect_timing = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.insecure = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.keyfile = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.split_loggers = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] barbican_service_user.timeout = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.approle_role_id = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.approle_secret_id = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.auth_method = approle {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.auth_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.kv_mountpoint = secret {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.kv_path = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.kv_version = 2 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.namespace = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.root_token_id = **** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.ssl_ca_crt_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.timeout = 60.0 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.token_file = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.token_role = None {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.use_ssl = False {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 06:48:59 devstack cinder-volume[94162]: DEBUG oslo_service.backend._eventlet.service [None req-013fa13b-1c8f-4b91-8a2f-a47463c36249 None None] ******************************************************************************** {{(pid=94162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 06:49:00 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.268s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.volume.driver [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Driver hasn't implemented _init_vendor_properties() Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.volume.driver [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94460) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_db.sqlalchemy.engines [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writer thread running {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.db.api [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Building query based on filter {{(pid=94460) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94460) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.keymgr.migration [None req-f130b5ae-9c0c-4417-a6c7-080d1b6e4529 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 06:49:00 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:49:00 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:00 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.228s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Driver initialization completed successfully. Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Initiating service 3 cleanup Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Service 3 cleanup completed. Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.service [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Creating RPC server for service cinder-volume {{(pid=94460) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.service [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94460) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:00 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:49:00 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:00 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.224s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83184876-32ea-4d6e-a7df-93a9bc3add92 None None] Driver post RPC initialization completed successfully. Aug 25 06:49:09 devstack cinder-volume[94162]: DEBUG dbcounter [-] [94162] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:49:10 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:49:10 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=4 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:49:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:49:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 6 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:49:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Flow 'volume_create_manager' (4311682b-be56-4d3b-89a3-75f2d0e0b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685538c6-23dd-4b5f-98e7-5b8c6055e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685538c6-23dd-4b5f-98e7-5b8c6055e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-829633728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e450080d0524fcf9311dacab9dba902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:49:59Z,use_quota=True,user_id='da200cfa80594c5eaea3b14b963bf3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1172309b-a736-4ba0-9fea-550d506cd969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1172309b-a736-4ba0-9fea-550d506cd969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b806fffd-8866-4891-b525-dba48421d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b806fffd-8866-4891-b525-dba48421d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e', 'volume_name': 'volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31544d7a-22e6-4aa2-9606-82f86c3693a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31544d7a-22e6-4aa2-9606-82f86c3693a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362c5c61-5d61-4278-8608-21d2a7fc7154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:49:58 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Volume 45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e', 'volume_size': 1} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-829633728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e450080d0524fcf9311dacab9dba902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:49:59Z,use_quota=True,user_id='da200cfa80594c5eaea3b14b963bf3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Creating volume 45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:49:58 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:49:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:58 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e 1073741824 Aug 25 06:49:58 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:49:59 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Aug 25 06:49:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e 1073741824" returned: 0 in 0.735s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:49:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:49:59 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e Aug 25 06:49:59 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:00 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e" returned: 0 in 0.364s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362c5c61-5d61-4278-8608-21d2a7fc7154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127572e5-265a-46e5-862b-6e7fad714599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:00 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Volume volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e (45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e): created successfully Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127572e5-265a-46e5-862b-6e7fad714599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Flow 'volume_create_manager' (4311682b-be56-4d3b-89a3-75f2d0e0b112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e1ea5ba7-fd32-441a-b707-d18b2e3fff50 tempest-TaggedAttachmentsTest-423424743 None] Created volume successfully. Aug 25 06:50:10 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:10 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Flow 'volume_create_manager' (c2eb2373-bd87-4c31-8aec-033938089bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c268edf-cc50-4b74-8061-b079508c56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c268edf-cc50-4b74-8061-b079508c56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1859250165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3720d521-c4a5-4304-a3ed-321f562ed4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d9ac49e384448e83e663b126433877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:28Z,use_quota=True,user_id='01d2f71066b849baa1de7a4157745c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b91b54-2e8e-485c-beb3-5fa478cafc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b91b54-2e8e-485c-beb3-5fa478cafc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9cb0b5-e741-46f9-b71a-e40c9649dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9cb0b5-e741-46f9-b71a-e40c9649dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3720d521-c4a5-4304-a3ed-321f562ed4dc', 'volume_name': 'volume-3720d521-c4a5-4304-a3ed-321f562ed4dc', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03dc32f-767c-4b84-b3f1-0a1a585edc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03dc32f-767c-4b84-b3f1-0a1a585edc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d8f280-b8e5-45b5-9478-a32a827891fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:28 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Volume 3720d521-c4a5-4304-a3ed-321f562ed4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3720d521-c4a5-4304-a3ed-321f562ed4dc', 'volume_size': 1} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1859250165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3720d521-c4a5-4304-a3ed-321f562ed4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d9ac49e384448e83e663b126433877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:28Z,use_quota=True,user_id='01d2f71066b849baa1de7a4157745c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Creating volume 3720d521-c4a5-4304-a3ed-321f562ed4dc {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:50:28 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:50:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:28 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc 1073741824 Aug 25 06:50:28 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:29 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc 1073741824" returned: 0 in 0.876s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:29 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc Aug 25 06:50:29 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:29 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d8f280-b8e5-45b5-9478-a32a827891fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3720d521-c4a5-4304-a3ed-321f562ed4dc', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff2f60c-49e0-4a05-aade-5163e3d24bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:29 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Volume volume-3720d521-c4a5-4304-a3ed-321f562ed4dc (3720d521-c4a5-4304-a3ed-321f562ed4dc): created successfully Aug 25 06:50:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff2f60c-49e0-4a05-aade-5163e3d24bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Flow 'volume_create_manager' (c2eb2373-bd87-4c31-8aec-033938089bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-053104e6-c089-4e8a-b265-b30ad70e7807 tempest-VolumesAdminNegativeTest-1985921304 None] Created volume successfully. Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:31 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:50:31 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Acquiring lock "cinder-3720d521-c4a5-4304-a3ed-321f562ed4dc-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "cinder-3720d521-c4a5-4304-a3ed-321f562ed4dc-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Acquiring lock "cinder-quobyte-3720d521-c4a5-4304-a3ed-321f562ed4dc" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "cinder-quobyte-3720d521-c4a5-4304-a3ed-321f562ed4dc" acquired by "delete_volume" :: waited 0.049s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:50:32 devstack cinder-volume[94460]: INFO oslo.privsep.daemon [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4s7hioin/privsep.sock'] Aug 25 06:50:32 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4s7hioin/privsep.sock Aug 25 06:50:32 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:32 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.727s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 7 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:50:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: Aug 25 06:50:33 devstack cinder-volume[94460]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 25 06:50:33 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:33 devstack cinder-volume[94460]: INFO oslo.privsep.daemon [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Spawned new privsep daemon via rootwrap Aug 25 06:50:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Accepted privsep connection to /tmp/tmp4s7hioin/privsep.sock {{(pid=94460) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 25 06:50:33 devstack cinder-volume[94460]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 25 06:50:33 devstack cinder-volume[94460]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 25 06:50:33 devstack cinder-volume[94460]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 25 06:50:33 devstack cinder-volume[94460]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95707 Aug 25 06:50:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce616e2-2a3d-4f10-9aaa-70dae20d1af8]: (2,) {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:50:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba75656-79e6-4954-a8d2-fbaec5a20512]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:50:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:34 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc Aug 25 06:50:34 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:34 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc" returned: 0 in 0.763s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:34 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc Aug 25 06:50:34 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:35 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3720d521-c4a5-4304-a3ed-321f562ed4dc" returned: 0 in 0.427s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "cinder-quobyte-3720d521-c4a5-4304-a3ed-321f562ed4dc" released by "delete_volume" :: held 2.988s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:50:35 devstack cinder-volume[94460]: WARNING cinder.quota [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:50:35 devstack cinder-volume[94460]: WARNING cinder.quota [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Created reservations ['d9b3842e-b9f8-4973-a9ef-26741b6abe82', '10a6c201-56ae-4a9e-a615-cc43b5251182', '7517a19b-b3d3-437e-be13-ca3d33d1b13b', 'b6f8fdac-7d97-450f-bf1c-4248ca01ff7e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:35 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:50:35 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:35 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.474s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:35 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:50:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Deleted volume successfully. Aug 25 06:50:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-049af13a-28e9-4481-affd-0d3c1d2f6632 tempest-VolumesAdminNegativeTest-1985921304 None] Lock "cinder-3720d521-c4a5-4304-a3ed-321f562ed4dc-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=2 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Flow 'volume_create_manager' (a04de2ae-1e86-4f4f-832e-33ce928f3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c48429c-5a32-4fbd-8075-b662c207df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c48429c-5a32-4fbd-8075-b662c207df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2055103623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5d7236-d3e6-4162-ab56-b833fc8cf77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dce0fbf400c481094ca205518cf95ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:46Z,use_quota=True,user_id='45612b7dbd2045ccb7575bf3044b97e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73e8335-7c07-483d-bb89-f75b67d9aeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73e8335-7c07-483d-bb89-f75b67d9aeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9460ed-86c4-483b-8564-85513a7d1de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9460ed-86c4-483b-8564-85513a7d1de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5d7236-d3e6-4162-ab56-b833fc8cf77d', 'volume_name': 'volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7c144a-ba8e-4663-a943-110027aaadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7c144a-ba8e-4663-a943-110027aaadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7370da7c-0e23-4df3-9411-8e7ee452b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:45 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Volume bb5d7236-d3e6-4162-ab56-b833fc8cf77d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d', 'volume_size': 1} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2055103623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5d7236-d3e6-4162-ab56-b833fc8cf77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dce0fbf400c481094ca205518cf95ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:46Z,use_quota=True,user_id='45612b7dbd2045ccb7575bf3044b97e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Creating volume bb5d7236-d3e6-4162-ab56-b833fc8cf77d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:50:45 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:45 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d 1073741824 Aug 25 06:50:45 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:45 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=5,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:50:46 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d 1073741824" returned: 0 in 0.532s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:46 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d Aug 25 06:50:46 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:46 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7370da7c-0e23-4df3-9411-8e7ee452b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd3b840-58b6-48d7-92bf-75d513a77482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Volume volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d (bb5d7236-d3e6-4162-ab56-b833fc8cf77d): created successfully Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd3b840-58b6-48d7-92bf-75d513a77482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Flow 'volume_create_manager' (a04de2ae-1e86-4f4f-832e-33ce928f3bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-163e43d0-359d-4fe5-970b-3fd64e8e21fd tempest-AttachVolumeTestJSON-1597622351 None] Created volume successfully. Aug 25 06:50:51 devstack cinder-volume[94460]: WARNING py.warnings [req-6b90f10a-2fa5-4b30-a392-cec0e20bcb9c req-8ba9b9fa-c60e-4cf6-9732-ab83387418a2 tempest-AttachVolumeTestJSON-1597622351 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 25 06:50:51 devstack cinder-volume[94460]: .first() Aug 25 06:50:51 devstack cinder-volume[94460]: Aug 25 06:50:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-6b90f10a-2fa5-4b30-a392-cec0e20bcb9c req-8ba9b9fa-c60e-4cf6-9732-ab83387418a2 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-6b90f10a-2fa5-4b30-a392-cec0e20bcb9c req-8ba9b9fa-c60e-4cf6-9732-ab83387418a2 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-6b90f10a-2fa5-4b30-a392-cec0e20bcb9c req-8ba9b9fa-c60e-4cf6-9732-ab83387418a2 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-6b90f10a-2fa5-4b30-a392-cec0e20bcb9c req-8ba9b9fa-c60e-4cf6-9732-ab83387418a2 tempest-AttachVolumeTestJSON-1597622351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b97b77f-447b-4e54-9d91-b434b132272d', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:50:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-6b90f10a-2fa5-4b30-a392-cec0e20bcb9c req-8ba9b9fa-c60e-4cf6-9732-ab83387418a2 tempest-AttachVolumeTestJSON-1597622351 None] attachment_update completed successfully. Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Flow 'volume_create_manager' (b86d5e84-4cb9-43ea-8c3e-2a4bd2496bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd20372c-ed36-429b-a575-e0183b9c68fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd20372c-ed36-429b-a575-e0183b9c68fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1854315531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46d75ac-ec1a-4905-8350-39316a76e479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259e61f98dc84e7188609964035a0d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:58Z,use_quota=True,user_id='f3c94270d59c4dfcac967b09ad8dc488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274a01a1-6095-4aea-a332-208d5cb1ff63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274a01a1-6095-4aea-a332-208d5cb1ff63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cad7808-62b2-4908-81c0-f2c0b0a8f557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cad7808-62b2-4908-81c0-f2c0b0a8f557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46d75ac-ec1a-4905-8350-39316a76e479', 'volume_name': 'volume-a46d75ac-ec1a-4905-8350-39316a76e479', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00008fb7-58cb-48a7-927e-c99f23ab9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00008fb7-58cb-48a7-927e-c99f23ab9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65af13d-955e-47f5-90d4-a01be5fe5939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:50:58 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Volume a46d75ac-ec1a-4905-8350-39316a76e479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46d75ac-ec1a-4905-8350-39316a76e479', 'volume_size': 1} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1854315531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46d75ac-ec1a-4905-8350-39316a76e479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259e61f98dc84e7188609964035a0d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:50:58Z,use_quota=True,user_id='f3c94270d59c4dfcac967b09ad8dc488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Creating volume a46d75ac-ec1a-4905-8350-39316a76e479 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:50:58 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:50:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:58 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 1073741824 Aug 25 06:50:58 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:50:59 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Aug 25 06:50:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 1073741824" returned: 0 in 1.180s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:50:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:50:59 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 Aug 25 06:50:59 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:00 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479" returned: 0 in 0.725s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65af13d-955e-47f5-90d4-a01be5fe5939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46d75ac-ec1a-4905-8350-39316a76e479', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c42161-2403-4ede-b593-b63bbf94b29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:51:00 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Volume volume-a46d75ac-ec1a-4905-8350-39316a76e479 (a46d75ac-ec1a-4905-8350-39316a76e479): created successfully Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c42161-2403-4ede-b593-b63bbf94b29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:51:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Flow 'volume_create_manager' (b86d5e84-4cb9-43ea-8c3e-2a4bd2496bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:51:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c143453d-e703-469a-952b-93f27cf9efa8 tempest-DeleteServersTestJSON-1485380998 None] Created volume successfully. Aug 25 06:51:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-2beb08fd-8e7d-47cb-9f78-abf995aeb959 req-0cd7fece-037c-40f1-8ab3-6e71ebe2cf8c tempest-DeleteServersTestJSON-1485380998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-2beb08fd-8e7d-47cb-9f78-abf995aeb959 req-0cd7fece-037c-40f1-8ab3-6e71ebe2cf8c tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-2beb08fd-8e7d-47cb-9f78-abf995aeb959 req-0cd7fece-037c-40f1-8ab3-6e71ebe2cf8c tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-2beb08fd-8e7d-47cb-9f78-abf995aeb959 req-0cd7fece-037c-40f1-8ab3-6e71ebe2cf8c tempest-DeleteServersTestJSON-1485380998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-a46d75ac-ec1a-4905-8350-39316a76e479', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b2e7eba-0e5a-481c-a6f1-869d0e0dd9a3', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:51:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-2beb08fd-8e7d-47cb-9f78-abf995aeb959 req-0cd7fece-037c-40f1-8ab3-6e71ebe2cf8c tempest-DeleteServersTestJSON-1485380998 None] attachment_update completed successfully. Aug 25 06:51:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-1d7acec6-bbd3-48c2-9304-a16a0bb1a541 req-acdb7235-47a8-406a-8cfc-bf873a134c92 tempest-TaggedAttachmentsTest-423424743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-1d7acec6-bbd3-48c2-9304-a16a0bb1a541 req-acdb7235-47a8-406a-8cfc-bf873a134c92 tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-1d7acec6-bbd3-48c2-9304-a16a0bb1a541 req-acdb7235-47a8-406a-8cfc-bf873a134c92 tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-1d7acec6-bbd3-48c2-9304-a16a0bb1a541 req-acdb7235-47a8-406a-8cfc-bf873a134c92 tempest-TaggedAttachmentsTest-423424743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4af9ecea-bc21-4454-b44b-2a028189b497', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:51:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-1d7acec6-bbd3-48c2-9304-a16a0bb1a541 req-acdb7235-47a8-406a-8cfc-bf873a134c92 tempest-TaggedAttachmentsTest-423424743 None] attachment_update completed successfully. Aug 25 06:51:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-028041ae-9cf1-412f-a732-9bb64d6e4757 req-76d597ac-ea6d-4a39-978f-fd80362da013 tempest-DeleteServersTestJSON-1485380998 None] Terminate volume connection completed successfully. Aug 25 06:51:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-028041ae-9cf1-412f-a732-9bb64d6e4757 req-76d597ac-ea6d-4a39-978f-fd80362da013 tempest-DeleteServersTestJSON-1485380998 None] Deleting attachment 5b2e7eba-0e5a-481c-a6f1-869d0e0dd9a3. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:51:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-fcd7c5de-76e9-426d-9b38-b925b6b6cfe2 req-f4121781-8fc4-4dfd-b934-a702532c81bc tempest-TaggedAttachmentsTest-423424743 None] Terminate volume connection completed successfully. Aug 25 06:51:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-fcd7c5de-76e9-426d-9b38-b925b6b6cfe2 req-f4121781-8fc4-4dfd-b934-a702532c81bc tempest-TaggedAttachmentsTest-423424743 None] Deleting attachment 4af9ecea-bc21-4454-b44b-2a028189b497. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:51:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Acquiring lock "cinder-a46d75ac-ec1a-4905-8350-39316a76e479-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Lock "cinder-a46d75ac-ec1a-4905-8350-39316a76e479-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Acquiring lock "cinder-quobyte-a46d75ac-ec1a-4905-8350-39316a76e479" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Lock "cinder-quobyte-a46d75ac-ec1a-4905-8350-39316a76e479" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6644d43b-3094-4221-9efa-731a6ddd52a7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:51:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:11 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 Aug 25 06:51:11 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:12 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479" returned: 0 in 0.398s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:12 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479 Aug 25 06:51:12 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:12 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a46d75ac-ec1a-4905-8350-39316a76e479" returned: 0 in 0.467s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Lock "cinder-quobyte-a46d75ac-ec1a-4905-8350-39316a76e479" released by "delete_volume" :: held 0.915s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Created reservations ['e4dc7e47-84e9-4efd-819a-fc4403b904cf', '2bc649d3-87ac-4f81-b1d7-de59f97017e0', '75c27d54-17f0-4bc5-bfe2-7d07800061d6', 'cf08f7b3-dca9-4f66-84d1-614465d0b315'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:13 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:51:13 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:13 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.439s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:13 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Deleted volume successfully. Aug 25 06:51:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aeb7fb16-2e81-454a-ae8e-fe82405b706c tempest-DeleteServersTestJSON-1485380998 None] Lock "cinder-a46d75ac-ec1a-4905-8350-39316a76e479-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:22 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=33,cinder:UPDATE=19,cinder:INSERT=2 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:23 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=29,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=4 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Acquiring lock "cinder-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Lock "cinder-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Acquiring lock "cinder-quobyte-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:51:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Lock "cinder-quobyte-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:51:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce48187-d683-4380-a77c-34ef99f6940e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:51:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:28 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e Aug 25 06:51:28 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:28 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e" returned: 0 in 0.445s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:28 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e Aug 25 06:51:28 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:28 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Lock "cinder-quobyte-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e" released by "delete_volume" :: held 0.762s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Created reservations ['03721cc4-a918-4ca7-89de-a63f00103a3f', '9f2311ab-65d9-40b8-8459-609ed54316ad', '16878aad-b0d0-48d1-b71f-5df30fd43a45', '1d6587a7-13fe-4215-97d4-1da4765ef251'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:28 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:51:28 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:29 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.384s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:29 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:29 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Deleted volume successfully. Aug 25 06:51:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a30ef9ab-4194-46ea-8ea5-62c82e5a2cfe tempest-TaggedAttachmentsTest-423424743 None] Lock "cinder-45ec6ba5-2736-4d17-9a3b-8ba9a96dbc5e-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:51:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:51:31 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:51:31 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:51:32 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Aug 25 06:51:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:51:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:51:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:51:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 8 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:51:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:51:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-9dc9e964-8fc4-4ca9-ac11-ccceacdc079d req-000e6da6-96fc-440f-ad1d-fe12dedd9a88 tempest-AttachVolumeTestJSON-1597622351 None] Terminate volume connection completed successfully. Aug 25 06:51:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-9dc9e964-8fc4-4ca9-ac11-ccceacdc079d req-000e6da6-96fc-440f-ad1d-fe12dedd9a88 tempest-AttachVolumeTestJSON-1597622351 None] Deleting attachment 8b97b77f-447b-4e54-9d91-b434b132272d. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:51:42 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:51:42 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:52:09 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Flow 'volume_create_manager' (6b0d3430-6450-4319-9a41-f32ee75c58d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96389669-8ddd-44bf-8908-99202d6f122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96389669-8ddd-44bf-8908-99202d6f122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-130268017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809dea8b-e798-4197-8b69-ccb40336f370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2d8bfa5693417c9f2ffb07765fbc2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:10Z,use_quota=True,user_id='dcde354ae1ba499185980e37db4c19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec505d4-340c-4089-b96e-a686af4517f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec505d4-340c-4089-b96e-a686af4517f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7aa232-2ebe-46a3-92da-c89cb44d7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7aa232-2ebe-46a3-92da-c89cb44d7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809dea8b-e798-4197-8b69-ccb40336f370', 'volume_name': 'volume-809dea8b-e798-4197-8b69-ccb40336f370', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74f0f31-f5c1-4b17-ad36-7a4eb969f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74f0f31-f5c1-4b17-ad36-7a4eb969f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17214b6b-9827-4a41-951d-3cd6f8c2d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:10 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Volume 809dea8b-e798-4197-8b69-ccb40336f370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809dea8b-e798-4197-8b69-ccb40336f370', 'volume_size': 1} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-130268017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809dea8b-e798-4197-8b69-ccb40336f370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2d8bfa5693417c9f2ffb07765fbc2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:10Z,use_quota=True,user_id='dcde354ae1ba499185980e37db4c19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Creating volume 809dea8b-e798-4197-8b69-ccb40336f370 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:10 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:10 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 1073741824 Aug 25 06:52:10 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:10 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 1073741824" returned: 0 in 0.516s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:10 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 Aug 25 06:52:10 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:11 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17214b6b-9827-4a41-951d-3cd6f8c2d33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809dea8b-e798-4197-8b69-ccb40336f370', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e140c374-724c-4973-a9e7-a615a7ef9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Volume volume-809dea8b-e798-4197-8b69-ccb40336f370 (809dea8b-e798-4197-8b69-ccb40336f370): created successfully Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e140c374-724c-4973-a9e7-a615a7ef9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Flow 'volume_create_manager' (6b0d3430-6450-4319-9a41-f32ee75c58d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-71115851-ad58-4759-9454-4446e4f0e3c8 tempest-ServersNegativeTestJSON-613133477 None] Created volume successfully. Aug 25 06:52:15 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Flow 'volume_create_manager' (53f5aada-f97d-4347-ada3-124f7ae5a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c22ef21-8c7c-4e0f-9287-562344b81af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c22ef21-8c7c-4e0f-9287-562344b81af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-796949567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b28907e-819a-499d-abca-1331351eccb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2d8bfa5693417c9f2ffb07765fbc2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:16Z,use_quota=True,user_id='dcde354ae1ba499185980e37db4c19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a733d9a4-6d72-4a82-85d8-22c245392fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a733d9a4-6d72-4a82-85d8-22c245392fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c95b5f-0da2-4057-a839-32896ad16810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c95b5f-0da2-4057-a839-32896ad16810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b28907e-819a-499d-abca-1331351eccb0', 'volume_name': 'volume-0b28907e-819a-499d-abca-1331351eccb0', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8d91fd-98c0-4c88-b593-c8f38a3b88f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8d91fd-98c0-4c88-b593-c8f38a3b88f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16a137e-f0cb-4195-9a48-ea2a9d7bb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Volume 0b28907e-819a-499d-abca-1331351eccb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b28907e-819a-499d-abca-1331351eccb0', 'volume_size': 1} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-796949567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b28907e-819a-499d-abca-1331351eccb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2d8bfa5693417c9f2ffb07765fbc2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:16Z,use_quota=True,user_id='dcde354ae1ba499185980e37db4c19a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Creating volume 0b28907e-819a-499d-abca-1331351eccb0 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:16 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:16 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 1073741824 Aug 25 06:52:16 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:16 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 1073741824" returned: 0 in 0.674s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:16 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 Aug 25 06:52:16 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:17 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0" returned: 0 in 0.372s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16a137e-f0cb-4195-9a48-ea2a9d7bb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b28907e-819a-499d-abca-1331351eccb0', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440292f2-7b29-41c1-b081-3da8619b80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:17 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Volume volume-0b28907e-819a-499d-abca-1331351eccb0 (0b28907e-819a-499d-abca-1331351eccb0): created successfully Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440292f2-7b29-41c1-b081-3da8619b80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Flow 'volume_create_manager' (53f5aada-f97d-4347-ada3-124f7ae5a421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-44abed86-6d0a-46f2-b59f-60165702c84a tempest-ServersNegativeTestJSON-613133477 None] Created volume successfully. Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "cinder-0b28907e-819a-499d-abca-1331351eccb0-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-0b28907e-819a-499d-abca-1331351eccb0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "cinder-quobyte-0b28907e-819a-499d-abca-1331351eccb0" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-quobyte-0b28907e-819a-499d-abca-1331351eccb0" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcb6f49-dd79-4314-9b42-9c83953064c8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:19 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 Aug 25 06:52:19 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:19 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0" returned: 0 in 0.427s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:19 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0 Aug 25 06:52:19 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:20 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0b28907e-819a-499d-abca-1331351eccb0" returned: 0 in 0.320s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-quobyte-0b28907e-819a-499d-abca-1331351eccb0" released by "delete_volume" :: held 0.815s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Created reservations ['144c26d1-0146-4a37-a759-b93412336244', '01be6c2b-ef0a-407b-b4fe-b49153b38475', '87c8db7f-74db-4a48-b963-c1feb739dba9', '06099514-0c57-4205-8517-91ce755a47bc'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:20 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:52:20 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "cinder-809dea8b-e798-4197-8b69-ccb40336f370-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-809dea8b-e798-4197-8b69-ccb40336f370-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "cinder-quobyte-809dea8b-e798-4197-8b69-ccb40336f370" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-quobyte-809dea8b-e798-4197-8b69-ccb40336f370" acquired by "delete_volume" :: waited 0.051s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd714e-65b6-47a6-b4c7-332280ae8574]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:21 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.626s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:21 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Deleted volume successfully. Aug 25 06:52:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30f034e4-6114-4713-8f11-8565aed2c9a5 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-0b28907e-819a-499d-abca-1331351eccb0-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:21 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 Aug 25 06:52:21 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:21 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370" returned: 0 in 0.737s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:21 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370 Aug 25 06:52:21 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:22 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-809dea8b-e798-4197-8b69-ccb40336f370" returned: 0 in 0.390s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-quobyte-809dea8b-e798-4197-8b69-ccb40336f370" released by "delete_volume" :: held 1.224s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Created reservations ['13703e7b-3066-4b3e-9fb2-c8530669b2ef', '8b866368-113d-453b-8212-077b9b6518d9', '953ce444-9d00-4bac-8277-f88a17a34d2b', '8a80c9d7-36a1-431f-8d70-5952ed4a7048'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:22 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:52:22 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:22 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Deleted volume successfully. Aug 25 06:52:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2d88daf-0a4b-424e-9343-a2b07c1bfa35 tempest-ServersNegativeTestJSON-613133477 None] Lock "cinder-809dea8b-e798-4197-8b69-ccb40336f370-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:31 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:52:31 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:32 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=12,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.633s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 8 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:52:32 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=4 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Flow 'volume_create_manager' (e5244d80-06a2-4dc5-ac6c-df1a40048d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063ed3f0-c589-4faf-ad0a-06e5f6f2b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063ed3f0-c589-4faf-ad0a-06e5f6f2b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1986364451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d0cc8-ae79-4c7e-b6d4-8fce7b54e140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da54f7604e894400be15def08b156aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:33Z,use_quota=True,user_id='95fe6b25c04c40f2858b7d5b58ddafe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0a3924-e472-4db2-ad50-fc2f799451f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0a3924-e472-4db2-ad50-fc2f799451f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d28b2f-fbd7-4406-929f-e8089ac2c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d28b2f-fbd7-4406-929f-e8089ac2c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414d0cc8-ae79-4c7e-b6d4-8fce7b54e140', 'volume_name': 'volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c458fab0-d399-4f71-ab58-c535d7b0b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c458fab0-d399-4f71-ab58-c535d7b0b217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deb16cb-c748-46dd-9ab2-265290ad100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:33 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Volume 414d0cc8-ae79-4c7e-b6d4-8fce7b54e140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140', 'volume_size': 1} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1986364451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d0cc8-ae79-4c7e-b6d4-8fce7b54e140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da54f7604e894400be15def08b156aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:33Z,use_quota=True,user_id='95fe6b25c04c40f2858b7d5b58ddafe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Creating volume 414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:33 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:52:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:33 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 1073741824 Aug 25 06:52:33 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:34 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 1073741824" returned: 0 in 0.746s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:34 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 Aug 25 06:52:34 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:34 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140" returned: 0 in 0.371s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deb16cb-c748-46dd-9ab2-265290ad100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec52667c-3c39-4640-8b92-dba08df2f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Volume volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 (414d0cc8-ae79-4c7e-b6d4-8fce7b54e140): created successfully Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec52667c-3c39-4640-8b92-dba08df2f29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Flow 'volume_create_manager' (e5244d80-06a2-4dc5-ac6c-df1a40048d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0d21aa44-7e43-445b-bca6-c0ace7a0f089 tempest-AttachVolumeShelveTestJSON-177116331 None] Created volume successfully. Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Flow 'volume_create_manager' (b8bccc6b-047e-4abd-89fd-c828c40a3b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1083574c-4d36-465b-a2fe-b558ba91b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1083574c-4d36-465b-a2fe-b558ba91b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1841276835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c37dba-40d2-4fc4-9c58-face6e2d4f7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68adad16ff0f40c38b47136d9626499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:39Z,use_quota=True,user_id='71cb3b32194245409c680ca9daf690c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634efaf1-8ab9-4cfc-926c-a14bb8e5385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634efaf1-8ab9-4cfc-926c-a14bb8e5385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1beeb4-68d6-42fe-a775-a61f84283d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1beeb4-68d6-42fe-a775-a61f84283d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c37dba-40d2-4fc4-9c58-face6e2d4f7a', 'volume_name': 'volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cedae6b-e141-477f-8773-50a7e2b45d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cedae6b-e141-477f-8773-50a7e2b45d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190019a3-d8a8-4a29-8886-032e7e68855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:38 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Volume b1c37dba-40d2-4fc4-9c58-face6e2d4f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a', 'volume_size': 1} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1841276835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c37dba-40d2-4fc4-9c58-face6e2d4f7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68adad16ff0f40c38b47136d9626499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:39Z,use_quota=True,user_id='71cb3b32194245409c680ca9daf690c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Creating volume b1c37dba-40d2-4fc4-9c58-face6e2d4f7a {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:38 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:52:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:38 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a 1073741824 Aug 25 06:52:38 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:39 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a 1073741824" returned: 0 in 0.480s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:39 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a Aug 25 06:52:39 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:39 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a" returned: 0 in 0.262s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190019a3-d8a8-4a29-8886-032e7e68855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94373078-0b86-4e51-bce9-016b6897d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Volume volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a (b1c37dba-40d2-4fc4-9c58-face6e2d4f7a): created successfully Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94373078-0b86-4e51-bce9-016b6897d071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Flow 'volume_create_manager' (b8bccc6b-047e-4abd-89fd-c828c40a3b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-a08c7b3d-eacd-4bc1-8476-58baa072f736 req-6dedf4f0-daa9-4cda-b539-43ff7d147033 tempest-VolumesGetTestJSON-740793492 None] Created volume successfully. Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Acquiring lock "cinder-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Lock "cinder-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Acquiring lock "cinder-quobyte-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Lock "cinder-quobyte-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a10a0b-b7f8-49d8-b4dc-862be48c6534]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:40 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a Aug 25 06:52:40 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:40 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a" returned: 0 in 0.471s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:40 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a Aug 25 06:52:40 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:41 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Lock "cinder-quobyte-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a" released by "delete_volume" :: held 0.941s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG cinder.quota [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Created reservations ['e94aacae-1640-4a6d-a7e1-64770ef3b91b', '8aeac85e-ed08-4ac8-b5b9-4b46f5fe1cb9', '5586d0d9-7b1e-4a29-8ad1-12c1b7de132a', '9a64098c-5fc7-4d60-ae81-a75860a1647d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:41 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:52:41 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:41 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.498s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:41 devstack cinder-volume[94460]: DEBUG cinder.manager [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:52:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Deleted volume successfully. Aug 25 06:52:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-5494cb3a-9af0-4ad9-ba26-7d415aa865ef req-fa05efc0-9e77-4c04-9510-88a6c741494b tempest-VolumesGetTestJSON-740793492 None] Lock "cinder-b1c37dba-40d2-4fc4-9c58-face6e2d4f7a-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Flow 'volume_create_manager' (85d1c6f2-8acc-4774-a3d6-e5d92abe3081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9ff619-7937-4a84-a90b-33231afc64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9ff619-7937-4a84-a90b-33231afc64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-670645923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1fdb91-685e-429d-abad-0b009e3a1441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a6c4f73def417daa8d02f766204d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:45Z,use_quota=True,user_id='e5ce7ba3f71f447a9fe044107abbfb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b4a9b7-2921-40a6-8477-22cf7216778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b4a9b7-2921-40a6-8477-22cf7216778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8802dfe-ffe7-4c02-8677-f13a61551bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8802dfe-ffe7-4c02-8677-f13a61551bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1fdb91-685e-429d-abad-0b009e3a1441', 'volume_name': 'volume-4d1fdb91-685e-429d-abad-0b009e3a1441', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7513356-c00c-4f78-9356-5e54640dfd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7513356-c00c-4f78-9356-5e54640dfd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f19a7-4533-43b9-97b6-aa62ad685d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:45 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Volume 4d1fdb91-685e-429d-abad-0b009e3a1441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1fdb91-685e-429d-abad-0b009e3a1441', 'volume_size': 1} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-670645923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1fdb91-685e-429d-abad-0b009e3a1441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a6c4f73def417daa8d02f766204d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:45Z,use_quota=True,user_id='e5ce7ba3f71f447a9fe044107abbfb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Creating volume 4d1fdb91-685e-429d-abad-0b009e3a1441 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:45 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:52:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:45 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 1073741824 Aug 25 06:52:45 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:46 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 1073741824" returned: 0 in 0.685s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:46 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 Aug 25 06:52:46 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:46 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441" returned: 0 in 0.309s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f19a7-4533-43b9-97b6-aa62ad685d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1fdb91-685e-429d-abad-0b009e3a1441', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e11ff68-d5d7-458e-8b4b-ba92b03f1952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Volume volume-4d1fdb91-685e-429d-abad-0b009e3a1441 (4d1fdb91-685e-429d-abad-0b009e3a1441): created successfully Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e11ff68-d5d7-458e-8b4b-ba92b03f1952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Flow 'volume_create_manager' (85d1c6f2-8acc-4774-a3d6-e5d92abe3081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-110ac7a3-7045-4cba-a8f9-3a78f4b76e79 tempest-ServerActionsTestOtherA-186498983 None] Created volume successfully. Aug 25 06:52:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-2e01c62e-ff40-460c-b2b8-d7ff70ea63fc req-5446fec5-bb30-4949-b37b-78e5dab3ca11 tempest-AttachVolumeShelveTestJSON-177116331 None] No connector for attachment 4c41d3c0-9207-42dc-b0ce-91a0543e11e7; skipping storage backend terminate_connection call. {{(pid=94460) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5032}} Aug 25 06:52:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-2e01c62e-ff40-460c-b2b8-d7ff70ea63fc req-5446fec5-bb30-4949-b37b-78e5dab3ca11 tempest-AttachVolumeShelveTestJSON-177116331 None] Deleting attachment 4c41d3c0-9207-42dc-b0ce-91a0543e11e7. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:52:56 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Flow 'volume_create_manager' (f1d66124-2767-43c9-97bc-3dc118c5ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba8a5a0-4143-4d5c-b8b6-fce9d9d54d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba8a5a0-4143-4d5c-b8b6-fce9d9d54d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1486094253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d4dda1-7b2c-4a70-a129-75d72477fe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dce0fbf400c481094ca205518cf95ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:57Z,use_quota=True,user_id='45612b7dbd2045ccb7575bf3044b97e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c2426-59ce-4004-ac42-274a54badccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c2426-59ce-4004-ac42-274a54badccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64733fc-51e5-4975-8cf3-570d9aa0f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64733fc-51e5-4975-8cf3-570d9aa0f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d4dda1-7b2c-4a70-a129-75d72477fe56', 'volume_name': 'volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03281d9-c377-44f6-96ae-cfa18390f684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03281d9-c377-44f6-96ae-cfa18390f684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f124c7-410a-476e-9e4d-b5e40e63ec25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:57 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Volume a7d4dda1-7b2c-4a70-a129-75d72477fe56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56', 'volume_size': 1} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1486094253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d4dda1-7b2c-4a70-a129-75d72477fe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dce0fbf400c481094ca205518cf95ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:52:57Z,use_quota=True,user_id='45612b7dbd2045ccb7575bf3044b97e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Creating volume a7d4dda1-7b2c-4a70-a129-75d72477fe56 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:52:57 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:57 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 1073741824 Aug 25 06:52:57 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:57 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 1073741824" returned: 0 in 0.756s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:52:58 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 Aug 25 06:52:58 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:52:58 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f124c7-410a-476e-9e4d-b5e40e63ec25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e953503d-31df-4912-8ecd-978ed452f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:52:58 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Volume volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 (a7d4dda1-7b2c-4a70-a129-75d72477fe56): created successfully Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e953503d-31df-4912-8ecd-978ed452f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:52:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Flow 'volume_create_manager' (f1d66124-2767-43c9-97bc-3dc118c5ee40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:52:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7a9aea2d-07a3-4957-aaf7-2e38b9a5d3b6 tempest-AttachVolumeTestJSON-1597622351 None] Created volume successfully. Aug 25 06:53:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-76425cd7-05cf-4b69-9723-cd7bbcbd1efa req-24f9d5d2-693a-498c-8465-9da4ecdb09f1 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-76425cd7-05cf-4b69-9723-cd7bbcbd1efa req-24f9d5d2-693a-498c-8465-9da4ecdb09f1 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-76425cd7-05cf-4b69-9723-cd7bbcbd1efa req-24f9d5d2-693a-498c-8465-9da4ecdb09f1 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-76425cd7-05cf-4b69-9723-cd7bbcbd1efa req-24f9d5d2-693a-498c-8465-9da4ecdb09f1 tempest-AttachVolumeTestJSON-1597622351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '030bdf83-3f5f-4631-a5b4-01cbfc7d8622', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:53:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-76425cd7-05cf-4b69-9723-cd7bbcbd1efa req-24f9d5d2-693a-498c-8465-9da4ecdb09f1 tempest-AttachVolumeTestJSON-1597622351 None] attachment_update completed successfully. Aug 25 06:53:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83a71094-dfbc-433d-8cd9-ca688dd50f6c tempest-GroupsTest-1096097894 None] Group tempest-Group1-1679647595: creating Aug 25 06:53:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83a71094-dfbc-433d-8cd9-ca688dd50f6c tempest-GroupsTest-1096097894 None] Group tempest-Group1-1679647595: created successfully Aug 25 06:53:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83a71094-dfbc-433d-8cd9-ca688dd50f6c tempest-GroupsTest-1096097894 None] Create group completed successfully. Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Flow 'volume_create_manager' (fbaec969-95be-4c6a-a3f6-04e00cb1f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12643c4c-90fd-44f8-9986-f0dac09329c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12643c4c-90fd-44f8-9986-f0dac09329c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1601227695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245a1b73-77aa-4ad8-aa5f-9913379364da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dce0fbf400c481094ca205518cf95ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:05Z,use_quota=True,user_id='45612b7dbd2045ccb7575bf3044b97e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235449ca-0285-44d1-b072-7b60cd076ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235449ca-0285-44d1-b072-7b60cd076ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf50f237-fd51-48af-b578-5de818722cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf50f237-fd51-48af-b578-5de818722cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245a1b73-77aa-4ad8-aa5f-9913379364da', 'volume_name': 'volume-245a1b73-77aa-4ad8-aa5f-9913379364da', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc5cfdf-8609-47f5-b404-d304f431f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc5cfdf-8609-47f5-b404-d304f431f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbf0abd-4bec-4d47-a9eb-cab4f85767b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Volume 245a1b73-77aa-4ad8-aa5f-9913379364da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245a1b73-77aa-4ad8-aa5f-9913379364da', 'volume_size': 1} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1601227695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245a1b73-77aa-4ad8-aa5f-9913379364da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dce0fbf400c481094ca205518cf95ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:05Z,use_quota=True,user_id='45612b7dbd2045ccb7575bf3044b97e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Creating volume 245a1b73-77aa-4ad8-aa5f-9913379364da {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:04 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:05 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da 1073741824 Aug 25 06:53:05 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:05 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da 1073741824" returned: 0 in 0.871s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:06 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da Aug 25 06:53:06 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-081364aa-74a4-4512-b459-9e3bca5ccc6c tempest-GroupsTest-1096097894 None] Group tempest-Group2-968546445: creating Aug 25 06:53:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-081364aa-74a4-4512-b459-9e3bca5ccc6c tempest-GroupsTest-1096097894 None] Group tempest-Group2-968546445: created successfully Aug 25 06:53:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-081364aa-74a4-4512-b459-9e3bca5ccc6c tempest-GroupsTest-1096097894 None] Create group completed successfully. Aug 25 06:53:06 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da" returned: 0 in 0.663s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbf0abd-4bec-4d47-a9eb-cab4f85767b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245a1b73-77aa-4ad8-aa5f-9913379364da', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114223ed-d723-4a0e-b0cc-87c415736fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:06 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Volume volume-245a1b73-77aa-4ad8-aa5f-9913379364da (245a1b73-77aa-4ad8-aa5f-9913379364da): created successfully Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114223ed-d723-4a0e-b0cc-87c415736fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Flow 'volume_create_manager' (fbaec969-95be-4c6a-a3f6-04e00cb1f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ed3d0b15-2da1-4922-b90c-d3f7fd9aae34 tempest-AttachVolumeTestJSON-1597622351 None] Created volume successfully. Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Flow 'volume_create_manager' (dd3d5cc3-7a55-45f7-b1dd-1df2f8b81c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7151b2-58a7-4715-b1cd-a2d287910216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7151b2-58a7-4715-b1cd-a2d287910216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1115571039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71f387fc-8c5c-4f0f-b2ad-b0f4939e0e25,host='devstack@QuobyteHD#QuobyteHD',id=68967721-0db7-4a14-b8e6-7c23aee6271a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf4efb3102e40859c43590e798a6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:08Z,use_quota=True,user_id='a5398f5a59bb405490a1da04ca1ff9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(820a12dd-8dae-4799-90fe-1a8751caa2d9),volume_type_id=820a12dd-8dae-4799-90fe-1a8751caa2d9)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ab77af-4a0e-4758-807b-3f82cc65b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ab77af-4a0e-4758-807b-3f82cc65b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8e663b-9459-4d16-812b-c0c8151c75f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8e663b-9459-4d16-812b-c0c8151c75f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68967721-0db7-4a14-b8e6-7c23aee6271a', 'volume_name': 'volume-68967721-0db7-4a14-b8e6-7c23aee6271a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5411cd3-3c83-477b-ae0e-46a6fe323674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5411cd3-3c83-477b-ae0e-46a6fe323674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ea03e5-e12e-44c7-9b9f-53a047cf07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Volume 68967721-0db7-4a14-b8e6-7c23aee6271a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68967721-0db7-4a14-b8e6-7c23aee6271a', 'volume_size': 1} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71f387fc-8c5c-4f0f-b2ad-b0f4939e0e25,created_at=2026-08-25T04:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1115571039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71f387fc-8c5c-4f0f-b2ad-b0f4939e0e25,host='devstack@QuobyteHD#QuobyteHD',id=68967721-0db7-4a14-b8e6-7c23aee6271a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf4efb3102e40859c43590e798a6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:08Z,use_quota=True,user_id='a5398f5a59bb405490a1da04ca1ff9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(820a12dd-8dae-4799-90fe-1a8751caa2d9),volume_type_id=820a12dd-8dae-4799-90fe-1a8751caa2d9)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Creating volume 68967721-0db7-4a14-b8e6-7c23aee6271a {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:08 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-4deea91c-6489-475f-bcc1-936f536888ca req-1c3b6357-9004-420a-af8d-d4c7b5cb8fba tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:08 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a 1073741824 Aug 25 06:53:08 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:08 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a 1073741824" returned: 0 in 0.459s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:09 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a Aug 25 06:53:09 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:09 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-4deea91c-6489-475f-bcc1-936f536888ca req-1c3b6357-9004-420a-af8d-d4c7b5cb8fba tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.756s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ea03e5-e12e-44c7-9b9f-53a047cf07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68967721-0db7-4a14-b8e6-7c23aee6271a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd40625-49ab-4b43-bb71-7b7513f4569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-4deea91c-6489-475f-bcc1-936f536888ca req-1c3b6357-9004-420a-af8d-d4c7b5cb8fba tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:09 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Volume volume-68967721-0db7-4a14-b8e6-7c23aee6271a (68967721-0db7-4a14-b8e6-7c23aee6271a): created successfully Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd40625-49ab-4b43-bb71-7b7513f4569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Flow 'volume_create_manager' (dd3d5cc3-7a55-45f7-b1dd-1df2f8b81c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2be5ad5d-3ee1-4bc9-88da-72e1db937016 tempest-GroupsTest-1096097894 None] Created volume successfully. Aug 25 06:53:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-4deea91c-6489-475f-bcc1-936f536888ca req-1c3b6357-9004-420a-af8d-d4c7b5cb8fba tempest-AttachVolumeTestJSON-1597622351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-245a1b73-77aa-4ad8-aa5f-9913379364da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e31d392-4156-4cc5-8887-5e31a3d9bf0f', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:53:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-4deea91c-6489-475f-bcc1-936f536888ca req-1c3b6357-9004-420a-af8d-d4c7b5cb8fba tempest-AttachVolumeTestJSON-1597622351 None] attachment_update completed successfully. Aug 25 06:53:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Acquiring lock "cinder-quobyte-68967721-0db7-4a14-b8e6-7c23aee6271a" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Lock "cinder-quobyte-68967721-0db7-4a14-b8e6-7c23aee6271a" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb45ded-96d3-42d7-a4a1-4370d8dee7bb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:10 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a Aug 25 06:53:10 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:10 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a" returned: 0 in 0.375s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:10 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a Aug 25 06:53:10 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:11 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-68967721-0db7-4a14-b8e6-7c23aee6271a" returned: 0 in 0.259s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Lock "cinder-quobyte-68967721-0db7-4a14-b8e6-7c23aee6271a" released by "delete_volume" :: held 0.679s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Created reservations ['acbb96b5-a28c-4985-83dd-ae4f0cd85355'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:11 devstack cinder-volume[94460]: WARNING cinder.quota [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-694684904 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-694684904, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:11 devstack cinder-volume[94460]: WARNING cinder.quota [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-694684904 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-694684904, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Created reservations ['e96bfafd-d001-4b18-bef5-ac3cd8bfa05f', '6e5117d0-f215-45b9-9c98-1874a626666c', '75234d39-c064-4f98-8fd6-fd4a5b9c9f3b', '99805ed5-150c-400e-872d-8e8792fb87cb'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:11 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:11 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:11 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.282s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7bc14105-a274-4654-a92f-052f6f2942a8 tempest-GroupsTest-1096097894 None] Delete group completed successfully. Aug 25 06:53:11 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Created reservations ['128567b2-b14e-4cba-a849-06b97c70512e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:12 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:12 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:12 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.254s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-be6f28dc-980b-4586-b4f6-ff77726a32dd tempest-GroupsTest-1096097894 None] Delete group completed successfully. Aug 25 06:53:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-ddc12856-43a2-4452-bf25-0e1907caf3a2 req-6068da29-1c4e-42b2-921a-ab60198c495f tempest-AttachVolumeTestJSON-1597622351 None] Terminate volume connection completed successfully. Aug 25 06:53:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-ddc12856-43a2-4452-bf25-0e1907caf3a2 req-6068da29-1c4e-42b2-921a-ab60198c495f tempest-AttachVolumeTestJSON-1597622351 None] Deleting attachment 030bdf83-3f5f-4631-a5b4-01cbfc7d8622. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:53:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3c996bed-8631-4207-9a69-15333cac4a26 tempest-GroupsTest-1096097894 None] Group tempest-GroupsTest-Group-1115445982: creating Aug 25 06:53:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3c996bed-8631-4207-9a69-15333cac4a26 tempest-GroupsTest-1096097894 None] Group tempest-GroupsTest-Group-1115445982: created successfully Aug 25 06:53:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3c996bed-8631-4207-9a69-15333cac4a26 tempest-GroupsTest-1096097894 None] Create group completed successfully. Aug 25 06:53:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-2cce2baa-4bbc-467f-8194-62fa2b7327d3 req-d34f9d62-d93f-4855-bfeb-9643bae6b67b tempest-AttachVolumeTestJSON-1597622351 None] Terminate volume connection completed successfully. Aug 25 06:53:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-2cce2baa-4bbc-467f-8194-62fa2b7327d3 req-d34f9d62-d93f-4855-bfeb-9643bae6b67b tempest-AttachVolumeTestJSON-1597622351 None] Deleting attachment 2e31d392-4156-4cc5-8887-5e31a3d9bf0f. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Flow 'volume_create_manager' (937788e4-7eb9-4379-a266-962e87261d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99c4fdc-5c5d-4d81-90b4-196dac774cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99c4fdc-5c5d-4d81-90b4-196dac774cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-384040834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f618a6b5-e27e-4b58-b58b-8a1f3285adb4,host='devstack@QuobyteHD#QuobyteHD',id=efa7cac7-7c00-4d35-84b5-5dcb22e66f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf4efb3102e40859c43590e798a6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:15Z,use_quota=True,user_id='a5398f5a59bb405490a1da04ca1ff9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173f8b75-d681-490c-802b-c7786f861590),volume_type_id=173f8b75-d681-490c-802b-c7786f861590)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeee29d-c558-424e-b94c-2b0aeff6508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeee29d-c558-424e-b94c-2b0aeff6508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc82094f-12df-4af2-a00b-ce3edc52cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc82094f-12df-4af2-a00b-ce3edc52cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa7cac7-7c00-4d35-84b5-5dcb22e66f7a', 'volume_name': 'volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc106d65-e152-4439-8f67-a6a00996446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc106d65-e152-4439-8f67-a6a00996446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6885518-035c-4e57-9d92-2c2e905e8c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:15 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Volume efa7cac7-7c00-4d35-84b5-5dcb22e66f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a', 'volume_size': 1} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f618a6b5-e27e-4b58-b58b-8a1f3285adb4,created_at=2026-08-25T04:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-384040834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f618a6b5-e27e-4b58-b58b-8a1f3285adb4,host='devstack@QuobyteHD#QuobyteHD',id=efa7cac7-7c00-4d35-84b5-5dcb22e66f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf4efb3102e40859c43590e798a6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:15Z,use_quota=True,user_id='a5398f5a59bb405490a1da04ca1ff9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173f8b75-d681-490c-802b-c7786f861590),volume_type_id=173f8b75-d681-490c-802b-c7786f861590)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Creating volume efa7cac7-7c00-4d35-84b5-5dcb22e66f7a {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:15 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:15 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a 1073741824 Aug 25 06:53:15 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:16 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a 1073741824" returned: 0 in 0.854s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:16 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a Aug 25 06:53:16 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:17 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a" returned: 0 in 0.625s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6885518-035c-4e57-9d92-2c2e905e8c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7debcbaa-4d5c-431c-ae13-606b158303e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:17 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Volume volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a (efa7cac7-7c00-4d35-84b5-5dcb22e66f7a): created successfully Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7debcbaa-4d5c-431c-ae13-606b158303e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Flow 'volume_create_manager' (937788e4-7eb9-4379-a266-962e87261d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7e5f8ec2-3a9f-4b05-bef2-aa449e1ca52b tempest-GroupsTest-1096097894 None] Created volume successfully. Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Flow 'volume_create_manager' (ad760692-f523-42ee-81ba-4da28094381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277eb3a9-8c59-4189-b85a-ac7e25ea9a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277eb3a9-8c59-4189-b85a-ac7e25ea9a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-14733525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f618a6b5-e27e-4b58-b58b-8a1f3285adb4,host='devstack@QuobyteHD#QuobyteHD',id=73e0c81e-e666-4255-b411-24ba60dc438b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf4efb3102e40859c43590e798a6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:19Z,use_quota=True,user_id='a5398f5a59bb405490a1da04ca1ff9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173f8b75-d681-490c-802b-c7786f861590),volume_type_id=173f8b75-d681-490c-802b-c7786f861590)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c3d308-19c7-4772-be10-4e097fc86ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c3d308-19c7-4772-be10-4e097fc86ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670d63d8-830e-4767-a444-0e62820a8310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670d63d8-830e-4767-a444-0e62820a8310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e0c81e-e666-4255-b411-24ba60dc438b', 'volume_name': 'volume-73e0c81e-e666-4255-b411-24ba60dc438b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df8536-cf7f-4f52-9c19-2abefae54979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df8536-cf7f-4f52-9c19-2abefae54979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dfeef0-b28b-496c-a3ed-d5e025779851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Volume 73e0c81e-e666-4255-b411-24ba60dc438b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e0c81e-e666-4255-b411-24ba60dc438b', 'volume_size': 1} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f618a6b5-e27e-4b58-b58b-8a1f3285adb4,created_at=2026-08-25T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-14733525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f618a6b5-e27e-4b58-b58b-8a1f3285adb4,host='devstack@QuobyteHD#QuobyteHD',id=73e0c81e-e666-4255-b411-24ba60dc438b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf4efb3102e40859c43590e798a6c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:19Z,use_quota=True,user_id='a5398f5a59bb405490a1da04ca1ff9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173f8b75-d681-490c-802b-c7786f861590),volume_type_id=173f8b75-d681-490c-802b-c7786f861590)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Creating volume 73e0c81e-e666-4255-b411-24ba60dc438b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:18 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:18 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b 1073741824 Aug 25 06:53:18 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:19 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b 1073741824" returned: 0 in 0.490s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:19 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b Aug 25 06:53:19 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:19 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dfeef0-b28b-496c-a3ed-d5e025779851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e0c81e-e666-4255-b411-24ba60dc438b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e6ff08-f4ca-4302-97df-534b63b48a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Volume volume-73e0c81e-e666-4255-b411-24ba60dc438b (73e0c81e-e666-4255-b411-24ba60dc438b): created successfully Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e6ff08-f4ca-4302-97df-534b63b48a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Flow 'volume_create_manager' (ad760692-f523-42ee-81ba-4da28094381f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bd9d4cae-a0b3-4ba3-9768-f40fed6edb0f tempest-GroupsTest-1096097894 None] Created volume successfully. Aug 25 06:53:20 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3163968b-305f-4c6b-8697-038642c92904 tempest-GroupsTest-1096097894 None] Update group completed successfully. Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "cinder-245a1b73-77aa-4ad8-aa5f-9913379364da-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-245a1b73-77aa-4ad8-aa5f-9913379364da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "cinder-quobyte-245a1b73-77aa-4ad8-aa5f-9913379364da" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-quobyte-245a1b73-77aa-4ad8-aa5f-9913379364da" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eea3c1-4ea0-46f1-8cdc-44200771df63]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:20 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da Aug 25 06:53:20 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:20 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da" returned: 0 in 0.368s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:20 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da Aug 25 06:53:20 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:21 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-245a1b73-77aa-4ad8-aa5f-9913379364da" returned: 0 in 0.239s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-quobyte-245a1b73-77aa-4ad8-aa5f-9913379364da" released by "delete_volume" :: held 0.651s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Created reservations ['883121cd-0b72-4a1b-bf32-6d3e4ecf2e37', '18ae91de-f128-4430-a35a-c3faab3c5d87', '680ccb91-9c51-4c33-ba07-8cb37f88a4c1', '46b0b483-7c43-4f73-9c8d-99d41dd69cf4'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:21 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:21 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:21 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Deleted volume successfully. Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f4164410-1154-452c-8a66-2706591686a9 tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-245a1b73-77aa-4ad8-aa5f-9913379364da-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "cinder-a7d4dda1-7b2c-4a70-a129-75d72477fe56-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-a7d4dda1-7b2c-4a70-a129-75d72477fe56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "cinder-quobyte-a7d4dda1-7b2c-4a70-a129-75d72477fe56" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-quobyte-a7d4dda1-7b2c-4a70-a129-75d72477fe56" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f08767-37e4-4bd6-8c19-0fd4846fface]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:21 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 Aug 25 06:53:21 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-236a4071-c06f-4317-861d-1a1a137205aa tempest-GroupsTest-1096097894 None] Update group completed successfully. Aug 25 06:53:22 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:22 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56 Aug 25 06:53:22 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:22 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a7d4dda1-7b2c-4a70-a129-75d72477fe56" returned: 0 in 0.268s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-quobyte-a7d4dda1-7b2c-4a70-a129-75d72477fe56" released by "delete_volume" :: held 0.729s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-955c0391-398f-4831-8944-a0b1996b2614 req-f4d00ead-8780-47c5-8240-d4033c88a603 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-955c0391-398f-4831-8944-a0b1996b2614 req-f4d00ead-8780-47c5-8240-d4033c88a603 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-955c0391-398f-4831-8944-a0b1996b2614 req-f4d00ead-8780-47c5-8240-d4033c88a603 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-955c0391-398f-4831-8944-a0b1996b2614 req-f4d00ead-8780-47c5-8240-d4033c88a603 tempest-ServerActionsTestOtherA-186498983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-4d1fdb91-685e-429d-abad-0b009e3a1441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8d76bfe-4014-4e9f-93e6-e5728ad36dc0', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Created reservations ['7fb2b262-fb62-4301-b703-d0e3ff225c5f', '561d5488-bee7-44d2-a4fc-dd0679e6eac0', '7ec1a2c3-fc1f-441c-824f-098bf98e33f6', '7dec8d66-c319-416b-9b3d-37f00006f7c7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-955c0391-398f-4831-8944-a0b1996b2614 req-f4d00ead-8780-47c5-8240-d4033c88a603 tempest-ServerActionsTestOtherA-186498983 None] attachment_update completed successfully. Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:22 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:22 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:22 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.265s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Deleted volume successfully. Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-47ba05df-d42b-47f8-8042-9c32783f0f1c tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-a7d4dda1-7b2c-4a70-a129-75d72477fe56-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "cinder-bb5d7236-d3e6-4162-ab56-b833fc8cf77d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-bb5d7236-d3e6-4162-ab56-b833fc8cf77d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "cinder-quobyte-bb5d7236-d3e6-4162-ab56-b833fc8cf77d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-quobyte-bb5d7236-d3e6-4162-ab56-b833fc8cf77d" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b38ce-4c6e-492b-8a77-c168ed641a65]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:23 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d Aug 25 06:53:23 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:23 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d" returned: 0 in 0.432s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:23 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d Aug 25 06:53:23 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Acquiring lock "cinder-quobyte-73e0c81e-e666-4255-b411-24ba60dc438b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Lock "cinder-quobyte-73e0c81e-e666-4255-b411-24ba60dc438b" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb993ea5-5947-4904-a9f6-7bbd57c9b92f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:23 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bb5d7236-d3e6-4162-ab56-b833fc8cf77d" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-quobyte-bb5d7236-d3e6-4162-ab56-b833fc8cf77d" released by "delete_volume" :: held 0.742s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Created reservations ['54e1ed33-893b-4197-8608-d32c32bc98d5', '2b5f26c4-d78f-44c0-b7e6-306f96b43df4', 'c863d416-a87b-49b8-9fe9-906f30b0d098', '03955e8e-75e0-4405-80c0-59667b7ff862'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:23 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b Aug 25 06:53:23 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:23 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:23 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:23 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:24 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.259s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Deleted volume successfully. Aug 25 06:53:24 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b Aug 25 06:53:24 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-58ca9dd7-48d4-4138-889e-534fd7f16bba tempest-AttachVolumeTestJSON-1597622351 None] Lock "cinder-bb5d7236-d3e6-4162-ab56-b833fc8cf77d-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:24 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-73e0c81e-e666-4255-b411-24ba60dc438b" returned: 0 in 0.261s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Lock "cinder-quobyte-73e0c81e-e666-4255-b411-24ba60dc438b" released by "delete_volume" :: held 0.705s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Acquiring lock "cinder-quobyte-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Lock "cinder-quobyte-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4636eb08-9791-4853-9172-8561b805b13e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:24 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a Aug 25 06:53:24 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:24 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a" returned: 0 in 0.433s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:24 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a Aug 25 06:53:24 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:25 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a" returned: 0 in 0.325s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Lock "cinder-quobyte-efa7cac7-7c00-4d35-84b5-5dcb22e66f7a" released by "delete_volume" :: held 0.800s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Created reservations ['224539d6-c741-4949-8a36-5e32ab88ed7b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:25 devstack cinder-volume[94460]: WARNING cinder.quota [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1838756956 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1838756956, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:25 devstack cinder-volume[94460]: WARNING cinder.quota [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1838756956 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1838756956, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Created reservations ['20e0323b-b39e-4df8-8df9-7298a1995008', '7ef265f0-523c-4730-8515-4641d6a8127c', '433e14ba-ef02-4ac0-a4ea-44717c181f90', 'df7d09ed-a1ab-4a4d-9997-0079af6b473d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Created reservations ['ae23bd57-2a65-41ea-ba4d-33218797f7bc', 'e4dcc834-4c72-408b-ae0a-93ddcb5bf89d', '050920d2-99be-45d9-9645-4ac022f1f243', '62fb3c4f-a28b-4082-b789-47e3621f2766'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:25 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:25 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:25 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.293s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:25 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e752f07c-7afa-4922-9a49-36d3b2811848 tempest-GroupsTest-1096097894 None] Delete group completed successfully. Aug 25 06:53:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-69140e7d-5600-403d-af24-d80f1f1f8959 tempest-ServerActionsTestOtherA-186498983 None] Terminate volume connection completed successfully. Aug 25 06:53:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-69140e7d-5600-403d-af24-d80f1f1f8959 tempest-ServerActionsTestOtherA-186498983 None] Deleting attachment a8d76bfe-4014-4e9f-93e6-e5728ad36dc0. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:53:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-0e59686f-2cb9-4a9e-b70e-176a4c09971d tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-0e59686f-2cb9-4a9e-b70e-176a4c09971d tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-0e59686f-2cb9-4a9e-b70e-176a4c09971d tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-0e59686f-2cb9-4a9e-b70e-176a4c09971d tempest-ServerActionsTestOtherA-186498983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-4d1fdb91-685e-429d-abad-0b009e3a1441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb89ae29-ba27-41f9-adab-19d8ac0a776e', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:53:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-44610bf3-f18c-443c-805b-08fd5f4c4c7f req-0e59686f-2cb9-4a9e-b70e-176a4c09971d tempest-ServerActionsTestOtherA-186498983 None] attachment_update completed successfully. Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:31 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:31 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:32 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:35 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=104,cinder:SELECT=92,cinder:INSERT=16,cinder:DELETE=9 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:53:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f1da5d8e-11de-4022-92a1-cc2f89a6034b tempest-GroupsV320Test-1945319857 None] Group tempest-GroupsV320Test-Group-1626054694: creating Aug 25 06:53:35 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=113,cinder:UPDATE=94,cinder:INSERT=23,cinder:DELETE=3 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:53:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f1da5d8e-11de-4022-92a1-cc2f89a6034b tempest-GroupsV320Test-1945319857 None] Group tempest-GroupsV320Test-Group-1626054694: created successfully Aug 25 06:53:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f1da5d8e-11de-4022-92a1-cc2f89a6034b tempest-GroupsV320Test-1945319857 None] Create group completed successfully. Aug 25 06:53:35 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Flow 'volume_create_manager' (17105d11-af3f-40e3-99f2-43f9edfa2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415f08cc-259f-4992-966d-be49354f1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415f08cc-259f-4992-966d-be49354f1a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2043880893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21340b3a-e6e1-4709-b71c-f5c315d4897d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c940a78c9e9416fba60876cb97bbfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:36Z,use_quota=True,user_id='2b0a45aedd08447c9d4d8f72eaecf180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e15a3d-3c6e-4c56-8db2-2e76b1fcea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e15a3d-3c6e-4c56-8db2-2e76b1fcea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5625a0-b448-4e91-a593-c9073b497944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5625a0-b448-4e91-a593-c9073b497944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21340b3a-e6e1-4709-b71c-f5c315d4897d', 'volume_name': 'volume-21340b3a-e6e1-4709-b71c-f5c315d4897d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241f7f41-88c0-4dec-b4c8-d31f3277d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241f7f41-88c0-4dec-b4c8-d31f3277d271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a45d010-8043-443f-a0f1-ff65fbf5eab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Volume 21340b3a-e6e1-4709-b71c-f5c315d4897d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21340b3a-e6e1-4709-b71c-f5c315d4897d', 'volume_size': 1} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2043880893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21340b3a-e6e1-4709-b71c-f5c315d4897d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c940a78c9e9416fba60876cb97bbfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:36Z,use_quota=True,user_id='2b0a45aedd08447c9d4d8f72eaecf180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Creating volume 21340b3a-e6e1-4709-b71c-f5c315d4897d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:36 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:36 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d 1073741824 Aug 25 06:53:36 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Acquiring lock "cinder-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "cinder-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Acquiring lock "cinder-quobyte-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "cinder-quobyte-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6c6557-dfee-4ecf-9fb0-0aae8b1907fa]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:36 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 Aug 25 06:53:36 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:36 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d 1073741824" returned: 0 in 0.520s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:36 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d Aug 25 06:53:36 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:36 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140" returned: 0 in 0.416s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:36 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140 Aug 25 06:53:36 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:36 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d" returned: 0 in 0.330s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a45d010-8043-443f-a0f1-ff65fbf5eab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21340b3a-e6e1-4709-b71c-f5c315d4897d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baca970-149d-49f5-b379-307993f1a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Volume volume-21340b3a-e6e1-4709-b71c-f5c315d4897d (21340b3a-e6e1-4709-b71c-f5c315d4897d): created successfully Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baca970-149d-49f5-b379-307993f1a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Flow 'volume_create_manager' (17105d11-af3f-40e3-99f2-43f9edfa2276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9b7041df-fb0e-4e2b-8b3d-427cffdcd3d9 tempest-VolumesTestJSON-417890069 None] Created volume successfully. Aug 25 06:53:37 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140" returned: 0 in 0.348s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "cinder-quobyte-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140" released by "delete_volume" :: held 0.819s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Created reservations ['ac9fe2ff-8fa8-445f-a6ad-819c1ccb42e8', '1980d169-65e7-4aa1-9b6c-f31f87ab0ac7', 'b4a78eb9-08ac-405f-a093-91be767e3884', '9edf68f0-90db-424e-851f-ad4cedee4a20'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Created reservations ['c70c32a4-b0b3-480d-a87c-1c7fbb12f0a4'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:37 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:37 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:37 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:37 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:37 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4572bf25-1f3a-42b0-9bc5-5585c2e26e7a tempest-GroupsV320Test-1945319857 None] Delete group completed successfully. Aug 25 06:53:37 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.301s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Deleted volume successfully. Aug 25 06:53:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d792bb48-fc0e-4be8-8eb4-9cb6b5cbe978 tempest-AttachVolumeShelveTestJSON-177116331 None] Lock "cinder-414d0cc8-ae79-4c7e-b6d4-8fce7b54e140-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:38 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Flow 'volume_create_manager' (034f9a58-2a26-45eb-a8a7-e60e2c2a5060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6484eb8f-e87b-415f-a1e6-81e9c88c3647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6484eb8f-e87b-415f-a1e6-81e9c88c3647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1426867112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd25011-c1c4-48ff-9f5e-0931c026e03c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c940a78c9e9416fba60876cb97bbfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:39Z,use_quota=True,user_id='2b0a45aedd08447c9d4d8f72eaecf180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f82592-35fb-47d3-884b-b6b500cd2a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f82592-35fb-47d3-884b-b6b500cd2a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5baf973-653e-46ea-838c-12c85e5c6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5baf973-653e-46ea-838c-12c85e5c6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd25011-c1c4-48ff-9f5e-0931c026e03c', 'volume_name': 'volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3a7881-32ba-4e5f-9ae8-fb684448663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3a7881-32ba-4e5f-9ae8-fb684448663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f99bdf4-47c9-4fa0-802d-491abe986675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Volume 0dd25011-c1c4-48ff-9f5e-0931c026e03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c', 'volume_size': 1} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1426867112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd25011-c1c4-48ff-9f5e-0931c026e03c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c940a78c9e9416fba60876cb97bbfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:39Z,use_quota=True,user_id='2b0a45aedd08447c9d4d8f72eaecf180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Creating volume 0dd25011-c1c4-48ff-9f5e-0931c026e03c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:39 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:39 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c 1073741824 Aug 25 06:53:39 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:39 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c 1073741824" returned: 0 in 0.558s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:39 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c Aug 25 06:53:39 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:39 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c" returned: 0 in 0.302s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f99bdf4-47c9-4fa0-802d-491abe986675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a23dda7-6ea5-419c-8e18-a2c0b44c0b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Volume volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c (0dd25011-c1c4-48ff-9f5e-0931c026e03c): created successfully Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a23dda7-6ea5-419c-8e18-a2c0b44c0b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Flow 'volume_create_manager' (034f9a58-2a26-45eb-a8a7-e60e2c2a5060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b6de8df4-8c1e-4ef2-af9a-b084e3ce2bc6 tempest-VolumesTestJSON-417890069 None] Created volume successfully. Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Flow 'volume_create_manager' (ab247075-5c33-402e-a95e-c5dc97b2d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0aa542-4699-4063-a063-408a8f619a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0aa542-4699-4063-a063-408a8f619a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-381157116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbc414f-85c6-4b5c-8864-e52b65e30ce4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c940a78c9e9416fba60876cb97bbfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:42Z,use_quota=True,user_id='2b0a45aedd08447c9d4d8f72eaecf180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e222edb-514d-4ad1-9a50-2bf3d3de1dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e222edb-514d-4ad1-9a50-2bf3d3de1dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52b73e-6e5d-415b-a316-41776ff111bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52b73e-6e5d-415b-a316-41776ff111bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cbc414f-85c6-4b5c-8864-e52b65e30ce4', 'volume_name': 'volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5d1015-9e24-4362-84aa-9b6afeddc68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5d1015-9e24-4362-84aa-9b6afeddc68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9ff891-c56b-47fc-9b05-409d285692f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Volume 7cbc414f-85c6-4b5c-8864-e52b65e30ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4', 'volume_size': 1} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-381157116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbc414f-85c6-4b5c-8864-e52b65e30ce4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c940a78c9e9416fba60876cb97bbfa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:42Z,use_quota=True,user_id='2b0a45aedd08447c9d4d8f72eaecf180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Creating volume 7cbc414f-85c6-4b5c-8864-e52b65e30ce4 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:41 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:41 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 1073741824 Aug 25 06:53:41 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:42 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 1073741824" returned: 0 in 0.752s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:42 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 Aug 25 06:53:42 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:42 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4" returned: 0 in 0.349s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9ff891-c56b-47fc-9b05-409d285692f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fc2937-c4ae-4eac-be4a-26ab9bcc7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:43 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Volume volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 (7cbc414f-85c6-4b5c-8864-e52b65e30ce4): created successfully Aug 25 06:53:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fc2937-c4ae-4eac-be4a-26ab9bcc7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Flow 'volume_create_manager' (ab247075-5c33-402e-a95e-c5dc97b2d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-445f0d1c-d070-4596-aa8a-c366c4abe858 tempest-VolumesTestJSON-417890069 None] Created volume successfully. Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Acquiring lock "cinder-7cbc414f-85c6-4b5c-8864-e52b65e30ce4-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Lock "cinder-7cbc414f-85c6-4b5c-8864-e52b65e30ce4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Acquiring lock "cinder-quobyte-7cbc414f-85c6-4b5c-8864-e52b65e30ce4" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Lock "cinder-quobyte-7cbc414f-85c6-4b5c-8864-e52b65e30ce4" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd2fbd-3fdd-4e7f-b9e6-6b260202bfb7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:45 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 Aug 25 06:53:45 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:45 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4" returned: 0 in 0.490s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:45 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4 Aug 25 06:53:45 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:46 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7cbc414f-85c6-4b5c-8864-e52b65e30ce4" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Lock "cinder-quobyte-7cbc414f-85c6-4b5c-8864-e52b65e30ce4" released by "delete_volume" :: held 0.860s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Created reservations ['294b40f5-b994-4ab4-89c7-8f15104f3631', 'a9052303-fdbe-456f-a71e-c386fd028bf8', '7bb8b845-759f-4975-8f48-3f4b3dfd986a', '8588ee0c-69bf-4dc5-acb7-0a766ba6da7a'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:46 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:46 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Acquiring lock "cinder-0dd25011-c1c4-48ff-9f5e-0931c026e03c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Lock "cinder-0dd25011-c1c4-48ff-9f5e-0931c026e03c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Acquiring lock "cinder-quobyte-0dd25011-c1c4-48ff-9f5e-0931c026e03c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Lock "cinder-quobyte-0dd25011-c1c4-48ff-9f5e-0931c026e03c" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed9bcc-15c9-46c4-8a3e-4fccedcab02b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:46 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.296s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Deleted volume successfully. Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ee53bcfa-ba0d-45e2-9141-671531ccb170 tempest-VolumesTestJSON-417890069 None] Lock "cinder-7cbc414f-85c6-4b5c-8864-e52b65e30ce4-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:46 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c Aug 25 06:53:46 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:46 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c" returned: 0 in 0.416s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:46 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c Aug 25 06:53:46 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:47 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0dd25011-c1c4-48ff-9f5e-0931c026e03c" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Lock "cinder-quobyte-0dd25011-c1c4-48ff-9f5e-0931c026e03c" released by "delete_volume" :: held 0.762s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Created reservations ['8338bc93-904f-4553-9bb1-0f79bbbeeb5d', '35fa93d4-7f8f-45d6-b07a-68b0200d5181', 'd05f35ad-f0b0-4499-a56d-68e9566a8c0b', '84f576a3-99b0-4df0-b9cc-845e4ef63e19'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:47 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:47 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Acquiring lock "cinder-21340b3a-e6e1-4709-b71c-f5c315d4897d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Lock "cinder-21340b3a-e6e1-4709-b71c-f5c315d4897d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Acquiring lock "cinder-quobyte-21340b3a-e6e1-4709-b71c-f5c315d4897d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:53:47 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.325s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Deleted volume successfully. Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Lock "cinder-quobyte-21340b3a-e6e1-4709-b71c-f5c315d4897d" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c049090d-8b7b-4f2a-83ca-9d34a1220188]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-55068983-48d2-44ed-af3f-e370849aa606 tempest-VolumesTestJSON-417890069 None] Lock "cinder-0dd25011-c1c4-48ff-9f5e-0931c026e03c-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:47 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d Aug 25 06:53:47 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:48 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d" returned: 0 in 0.445s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:48 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d Aug 25 06:53:48 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:48 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-21340b3a-e6e1-4709-b71c-f5c315d4897d" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Lock "cinder-quobyte-21340b3a-e6e1-4709-b71c-f5c315d4897d" released by "delete_volume" :: held 0.774s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Created reservations ['26666c49-5fd6-4c2b-b984-d7ac165a37f2', '2840b06e-2b1a-4bad-a9b2-a4eadadfeed7', '1ecc8b5e-213a-4f34-83b8-d481600f10b0', '23150d6d-6984-4463-8c48-b0be3777a268'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:48 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:53:48 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:48 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.354s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:49 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:53:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Deleted volume successfully. Aug 25 06:53:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-36b7c585-c21d-463e-a1ed-9da059ee6a86 tempest-VolumesTestJSON-417890069 None] Lock "cinder-21340b3a-e6e1-4709-b71c-f5c315d4897d-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:53:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0c153b97-f5b5-4d07-895d-79bc2f23904f tempest-GroupSnapshotsTest-1521311395 None] Group tempest-GroupSnapshotsTest-Group-42362782: creating Aug 25 06:53:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0c153b97-f5b5-4d07-895d-79bc2f23904f tempest-GroupSnapshotsTest-1521311395 None] Group tempest-GroupSnapshotsTest-Group-42362782: created successfully Aug 25 06:53:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0c153b97-f5b5-4d07-895d-79bc2f23904f tempest-GroupSnapshotsTest-1521311395 None] Create group completed successfully. Aug 25 06:53:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6789678f-2c14-4ea0-9bc5-a802fb323ccd tempest-BackendsCapabilitiesAdminTestsJSON-946439604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94460) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4852}} Aug 25 06:53:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-90e052cb-4dfa-4642-acee-b94aa84bd63e tempest-BackendsCapabilitiesAdminTestsJSON-946439604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94460) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4852}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (33f2c4d4-0c05-4da4-a688-68a69c292831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69df3a2-facf-46cd-b878-208844478f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69df3a2-facf-46cd-b878-208844478f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808731061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5a5fe34-2605-4f20-8fe7-25f5f676b0e5,host='devstack@QuobyteHD#QuobyteHD',id=5a23cb38-cc97-4aaf-b79a-23694e5fce09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:54Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb78a36-2f1e-42bd-b386-64df00344398),volume_type_id=2eb78a36-2f1e-42bd-b386-64df00344398)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432419c7-7ae2-44f0-9f2a-9656ebbcd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432419c7-7ae2-44f0-9f2a-9656ebbcd5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00feb4d-3355-4604-ac4a-a47bf32a9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00feb4d-3355-4604-ac4a-a47bf32a9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a23cb38-cc97-4aaf-b79a-23694e5fce09', 'volume_name': 'volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e0033-0e1e-4b03-b6c7-df2eb9f6d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e0033-0e1e-4b03-b6c7-df2eb9f6d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fc9af6-2c62-46a6-836c-4adeca56feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:54 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Volume 5a23cb38-cc97-4aaf-b79a-23694e5fce09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09', 'volume_size': 1} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5a5fe34-2605-4f20-8fe7-25f5f676b0e5,created_at=2026-08-25T04:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808731061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5a5fe34-2605-4f20-8fe7-25f5f676b0e5,host='devstack@QuobyteHD#QuobyteHD',id=5a23cb38-cc97-4aaf-b79a-23694e5fce09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:53:54Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb78a36-2f1e-42bd-b386-64df00344398),volume_type_id=2eb78a36-2f1e-42bd-b386-64df00344398)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Creating volume 5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:53:54 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:54 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 1073741824 Aug 25 06:53:54 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:54 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 1073741824" returned: 0 in 0.544s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:54 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 Aug 25 06:53:54 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:55 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fc9af6-2c62-46a6-836c-4adeca56feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df765b1-ec67-4b75-9081-5b98778438b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:53:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Volume volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 (5a23cb38-cc97-4aaf-b79a-23694e5fce09): created successfully Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df765b1-ec67-4b75-9081-5b98778438b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (33f2c4d4-0c05-4da4-a688-68a69c292831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:53:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-378997b1-b658-45f8-901a-1f3937b0ead8 tempest-GroupSnapshotsTest-1521311395 None] Created volume successfully. Aug 25 06:53:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] GroupSnapshot d1cf5050-1267-48fd-bc16-39366c991c89: creating. Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Group snapshot d1cf5050-1267-48fd-bc16-39366c991c89: creating. {{(pid=94460) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4197}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:53:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Creating offline snapshot 7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 of volume 5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:53:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84be0f-822c-4d39-a475-2c88b369fd6a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:53:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:56 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 Aug 25 06:53:56 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:56 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09" returned: 0 in 0.426s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:56 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 1G Aug 25 06:53:56 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:56 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 1G" returned: 0 in 0.477s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:56 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 Aug 25 06:53:56 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:57 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" returned: 0 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:57 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:53:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:57 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 Aug 25 06:53:57 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:57 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" returned: 0 in 0.260s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:57 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info Aug 25 06:53:57 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:57 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info" returned: 0 in 0.322s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:57 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:53:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:53:57 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info Aug 25 06:53:57 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:53:58 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Aug 25 06:53:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.info" returned: 0 in 0.371s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:53:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:53:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-670ae49f-0c64-446b-a9fd-4066dde58420 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot d1cf5050-1267-48fd-bc16-39366c991c89: created successfully Aug 25 06:53:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-7433a138-fe7c-4b27-a5e8-d2a2255210ce req-2c22b035-abe0-4051-a4ae-3efa9f2f8ced tempest-ServerActionsTestOtherA-186498983 None] Terminate volume connection completed successfully. Aug 25 06:53:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-7433a138-fe7c-4b27-a5e8-d2a2255210ce req-2c22b035-abe0-4051-a4ae-3efa9f2f8ced tempest-ServerActionsTestOtherA-186498983 None] Deleting attachment eb89ae29-ba27-41f9-adab-19d8ac0a776e. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721-e972eca3-c439-452e-b46e-8ce2e20e88a0" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721-e972eca3-c439-452e-b46e-8ce2e20e88a0" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Creating volume e972eca3-c439-452e-b46e-8ce2e20e88a0 from snapshot 7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-e972eca3-c439-452e-b46e-8ce2e20e88a0" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-e972eca3-c439-452e-b46e-8ce2e20e88a0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] snapshot: 7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721, volume: e972eca3-c439-452e-b46e-8ce2e20e88a0, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575e269-4170-4192-8fcf-d94547a0bb52]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:00 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 Aug 25 06:54:00 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-81acda1f-5c3f-4c77-b62c-b4d5dbe59901 tempest-GroupSnapshotsV319Test-914210881 None] Group tempest-GroupSnapshotsV319Test-Group-1762971527: creating Aug 25 06:54:00 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" returned: 0 in 0.736s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-81acda1f-5c3f-4c77-b62c-b4d5dbe59901 tempest-GroupSnapshotsV319Test-914210881 None] Group tempest-GroupSnapshotsV319Test-Group-1762971527: created successfully Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff7114-a758-40d8-9f4f-715c43175b55]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-81acda1f-5c3f-4c77-b62c-b4d5dbe59901 tempest-GroupSnapshotsV319Test-914210881 None] Create group completed successfully. Aug 25 06:54:01 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 Aug 25 06:54:01 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:01 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09" returned: 0 in 0.502s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:54:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:54:01 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:54:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:01 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 Aug 25 06:54:01 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Flow 'volume_create_manager' (04502d23-b9e9-4bd3-a5fb-42c17b861305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228c153b-6278-49b1-afe5-633c975442a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228c153b-6278-49b1-afe5-633c975442a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-749862248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d86d8dad-d0aa-441d-a084-4f13885a060a,host='devstack@QuobyteHD#QuobyteHD',id=a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdf054ddf7e49dcab3d64d5b6e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:04Z,use_quota=True,user_id='8bb77be94cdd402b980412088d35430a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4ba2b3-8899-4297-b963-8caa6a457aec),volume_type_id=ff4ba2b3-8899-4297-b963-8caa6a457aec)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a04737d-2096-44d6-8b12-82f0d9baaed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a04737d-2096-44d6-8b12-82f0d9baaed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf1eb5-eefc-42f7-851a-bae889205b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf1eb5-eefc-42f7-851a-bae889205b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c', 'volume_name': 'volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95274160-cd6f-4f58-ab9d-b5fc9bf89b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95274160-cd6f-4f58-ab9d-b5fc9bf89b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7733adf-4a86-4f5c-9b43-6a9eaf716b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Volume a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c', 'volume_size': 1} Aug 25 06:54:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:07 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0" returned: 0 in 6.206s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:07 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:54:07 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Converted 1024.00 MB image at 164.97 MB/s Aug 25 06:54:07 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:07 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 Aug 25 06:54:07 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:08 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0" returned: 0 in 0.288s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-e972eca3-c439-452e-b46e-8ce2e20e88a0" released by "_copy_volume_from_snapshot" :: held 7.942s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721-e972eca3-c439-452e-b46e-8ce2e20e88a0" released by "_create_volume_from_snapshot" :: held 8.048s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.076s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.049s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d86d8dad-d0aa-441d-a084-4f13885a060a,created_at=2026-08-25T04:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-749862248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d86d8dad-d0aa-441d-a084-4f13885a060a,host='devstack@QuobyteHD#QuobyteHD',id=a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdf054ddf7e49dcab3d64d5b6e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:04Z,use_quota=True,user_id='8bb77be94cdd402b980412088d35430a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4ba2b3-8899-4297-b963-8caa6a457aec),volume_type_id=ff4ba2b3-8899-4297-b963-8caa6a457aec)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Creating volume a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:08 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:08 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c 1073741824 Aug 25 06:54:08 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-db825713-1a14-4142-ab3f-80b07792db3a tempest-GroupSnapshotsTest-1521311395 None] Create group from source-snapshot-d1cf5050-1267-48fd-bc16-39366c991c89 completed successfully. Aug 25 06:54:08 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c 1073741824" returned: 0 in 0.553s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:08 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c Aug 25 06:54:08 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Flow 'volume_create_manager' (61eec942-0975-4dff-851d-a581615ac19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c181b5f4-9ee8-419d-b3b7-d8fa05197ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c181b5f4-9ee8-419d-b3b7-d8fa05197ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-853649961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e0f790-3b18-44f8-8848-d0700114969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a6c4f73def417daa8d02f766204d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:09Z,use_quota=True,user_id='e5ce7ba3f71f447a9fe044107abbfb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27fd8fd8-6ee1-4139-8c19-50e3073b402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27fd8fd8-6ee1-4139-8c19-50e3073b402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1798a7a8-b263-44f8-8f5d-668eccece7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:54:08 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7733adf-4a86-4f5c-9b43-6a9eaf716b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a228d5b-e5f5-4d1e-aaa5-7d99c4db374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:09 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Volume volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c (a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c): created successfully Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a228d5b-e5f5-4d1e-aaa5-7d99c4db374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Flow 'volume_create_manager' (04502d23-b9e9-4bd3-a5fb-42c17b861305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-46895f92-bd5d-4df9-abbf-da7732a90bb1 tempest-GroupSnapshotsV319Test-914210881 None] Created volume successfully. Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-e972eca3-c439-452e-b46e-8ce2e20e88a0" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-e972eca3-c439-452e-b46e-8ce2e20e88a0" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89887f-e0eb-40eb-8731-deb7a13d3121]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:09 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 Aug 25 06:54:09 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] GroupSnapshot 6658ff10-b89f-4a67-a150-be9068bb317c: creating. Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Group snapshot 6658ff10-b89f-4a67-a150-be9068bb317c: creating. {{(pid=94460) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4197}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Creating offline snapshot 5eb28d26-470b-4d70-9f46-bcd07489f95f of volume a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:09 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cd27b2-2660-4e7a-ba49-088d34e26604]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1798a7a8-b263-44f8-8f5d-668eccece7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8e0f790-3b18-44f8-8848-d0700114969e', 'volume_name': 'volume-e8e0f790-3b18-44f8-8848-d0700114969e', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f368c0f-7a59-43e4-80ee-afea4e827552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f368c0f-7a59-43e4-80ee-afea4e827552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21530206-b1ce-477e-8f9b-7917b0a7832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:10 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Volume e8e0f790-3b18-44f8-8848-d0700114969e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8e0f790-3b18-44f8-8848-d0700114969e', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Trying to clone e8e0f790-3b18-44f8-8848-d0700114969e from image d970149c-5c62-44a8-b2c8-06c24c805604 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:54:10 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0" returned: 0 in 0.557s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0 Aug 25 06:54:10 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c Aug 25 06:54:10 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:54:10 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c8ea6d-cada-4d5e-b218-fbca6c10af3c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e972eca3-c439-452e-b46e-8ce2e20e88a0" returned: 0 in 0.459s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:10 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" returned: 0 in 0.562s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-e972eca3-c439-452e-b46e-8ce2e20e88a0" released by "delete_volume" :: held 1.078s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:10 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f 1G Aug 25 06:54:10 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['0c41e25a-ee20-4584-bec6-01c545b29612'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:10 devstack cinder-volume[94460]: WARNING cinder.quota [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1885178436 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1885178436, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:10 devstack cinder-volume[94460]: WARNING cinder.quota [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1885178436 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1885178436, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:10 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD Aug 25 06:54:10 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['802c8d78-9201-4305-86b9-c5b807ff1f20', '156e0a38-3389-4aa5-b69a-2a5caf10340c', '286005ee-d8b4-427e-bbe2-9931d6c585bc', '6ebf163a-2c49-41cb-b88e-49fe5d816145'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:10 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:10 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:11 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 is fetched for user e5ce7ba3f71f447a9fe044107abbfb29. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:54:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot d1cf5050-1267-48fd-bc16-39366c991c89: deleting Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot d1cf5050-1267-48fd-bc16-39366c991c89: deleting {{(pid=94460) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4372}} Aug 25 06:54:11 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f 1G" returned: 0 in 0.613s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:11 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f Aug 25 06:54:11 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-5a23cb38-cc97-4aaf-b79a-23694e5fce09" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828665c-792a-4e72-8fcb-58b5294d7782]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-5a23cb38-cc97-4aaf-b79a-23694e5fce09" acquired by "delete_snapshot" :: waited 0.053s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:11 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Deleting offline snapshot 7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 of volume 5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] snapshot_file for this snap is: volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.507s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86b429c-f87a-4693-848a-43e1208bc0ca]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b3410731-ba93-4902-897f-706f934999ee tempest-GroupSnapshotsTest-1521311395 None] Delete group completed successfully. Aug 25 06:54:11 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD Aug 25 06:54:11 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:11 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 Aug 25 06:54:11 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:11 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f" returned: 0 in 0.474s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:11 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f Aug 25 06:54:11 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:11 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:11 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" returned: 0 in 0.481s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da60ce1-6905-48f5-80c0-34e811f2da24]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:11 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f" returned: 0 in 0.266s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:11 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info Aug 25 06:54:11 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 Aug 25 06:54:12 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:12 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:12 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info Aug 25 06:54:12 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09" returned: 0 in 0.621s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:12 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.info" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:12 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 Aug 25 06:54:12 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-853649961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e0f790-3b18-44f8-8848-d0700114969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a6c4f73def417daa8d02f766204d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:09Z,use_quota=True,user_id='e5ce7ba3f71f447a9fe044107abbfb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Creating volume e8e0f790-3b18-44f8-8848-d0700114969e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:12 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:12 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e 1073741824 Aug 25 06:54:12 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-96c7cbf1-edef-4d64-9bef-df8406158b70 tempest-GroupSnapshotsV319Test-914210881 None] group_snapshot 6658ff10-b89f-4a67-a150-be9068bb317c: created successfully Aug 25 06:54:12 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:13 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721 Aug 25 06:54:13 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:13 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e 1073741824" returned: 0 in 0.630s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:13 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e Aug 25 06:54:13 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:13 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09.7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-7ee6a676-ba6d-4d1b-9c7e-e3db6e2b5721" released by "_delete_snapshot" :: held 2.044s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-5a23cb38-cc97-4aaf-b79a-23694e5fce09" released by "delete_snapshot" :: held 2.094s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:13 devstack cinder-volume[94460]: WARNING cinder.quota [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1885178436 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1885178436, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['88da487f-f625-4b31-abae-2d6dd299435a', '9b78e9c7-bdb3-4460-b1d6-c70f7bfe19e6', 'ada0b8ca-269f-42fa-9eb9-ddd2e2733282', '8d8a12b1-d4b4-4e95-b435-ecb0203d1e93'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-dc2b4c3f-1c0f-47ea-ad1b-1ab746ae5498 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot d1cf5050-1267-48fd-bc16-39366c991c89: deleted successfully Aug 25 06:54:13 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e" returned: 0 in 0.331s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Attempting download of d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume e8e0f790-3b18-44f8-8848-d0700114969e. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[29558597-da5b-417b-ad03-8436eb53e20a]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] group_snapshot 6658ff10-b89f-4a67-a150-be9068bb317c: deleting Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] group_snapshot 6658ff10-b89f-4a67-a150-be9068bb317c: deleting {{(pid=94460) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4372}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "cinder-quobyte-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Lock "cinder-quobyte-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "cinder-quobyte-5eb28d26-470b-4d70-9f46-bcd07489f95f" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Lock "cinder-quobyte-5eb28d26-470b-4d70-9f46-bcd07489f95f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Deleting offline snapshot 5eb28d26-470b-4d70-9f46-bcd07489f95f of volume a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:13 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc Aug 25 06:54:13 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] snapshot_file for this snap is: volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c2e9c9-6854-4026-afbd-5d8a1eccf7c6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:13 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f Aug 25 06:54:13 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:14 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc" returned: 0 in 0.357s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:14 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc Aug 25 06:54:14 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:14 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f" returned: 0 in 0.374s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[819910f7-b81a-4d2d-8437-26da0dc75b2a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:14 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c Aug 25 06:54:14 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:14 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc" returned: 1 in 0.380s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_r5sv0_sc' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e495f1-47da-40b1-8e49-0c4277bb7852]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:14 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD Aug 25 06:54:14 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:14 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" returned: 0 in 0.467s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:14 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f Aug 25 06:54:14 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-5a23cb38-cc97-4aaf-b79a-23694e5fce09" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-5a23cb38-cc97-4aaf-b79a-23694e5fce09" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8154bf0-0cba-4768-bb4f-464576cbfe89]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:14 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] d970149c-5c62-44a8-b2c8-06c24c805604 was qcow2, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:54:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:14 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e Aug 25 06:54:14 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 Aug 25 06:54:15 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f" returned: 0 in 0.463s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:15 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f Aug 25 06:54:15 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09" returned: 0 in 0.472s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:15 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09 Aug 25 06:54:15 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:15 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c.5eb28d26-470b-4d70-9f46-bcd07489f95f" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Lock "cinder-quobyte-5eb28d26-470b-4d70-9f46-bcd07489f95f" released by "_delete_snapshot" :: held 1.757s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Lock "cinder-quobyte-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" released by "delete_snapshot" :: held 1.785s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:15 devstack cinder-volume[94460]: WARNING cinder.quota [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1562111872 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1562111872, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:15 devstack cinder-volume[94460]: WARNING cinder.quota [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1562111872 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1562111872, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:15 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5a23cb38-cc97-4aaf-b79a-23694e5fce09" returned: 0 in 0.325s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-5a23cb38-cc97-4aaf-b79a-23694e5fce09" released by "delete_volume" :: held 0.892s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] Created reservations ['52a59829-d589-4894-b597-9fec580a1219', 'aa36d9f2-39e4-4048-9a9d-8220039e9f5a', '2ade70c9-2ac7-43b8-9de2-6672eef85b45', '884be5c2-7967-4c0a-b0fd-d0568412ffaf'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['bd19403c-2aab-4189-a648-fe16a0e094df'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ae397d5e-6e2b-42ff-9ae8-b6cad6a1e537 tempest-GroupSnapshotsV319Test-914210881 None] group_snapshot 6658ff10-b89f-4a67-a150-be9068bb317c: deleted successfully Aug 25 06:54:15 devstack cinder-volume[94460]: WARNING cinder.db.api [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1885178436'] Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['bc8ec39d-6348-421c-9f6b-b15fc7cc14f6', 'de0fd97e-80ed-4d4a-bfab-28d55380d8c5', '9f7c1e07-3adc-43e8-9bd0-fc1cf0c6ce9c', '10a97cda-aeec-4421-8bf3-c6175cee7a46'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:16 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:16 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:16 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:16 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bbd314ec-b0e2-45f7-9c6f-a44b4eb9d47f tempest-GroupSnapshotsTest-1521311395 None] Delete group completed successfully. Aug 25 06:54:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "cinder-quobyte-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Lock "cinder-quobyte-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" acquired by "delete_volume" :: waited 0.038s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:16 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[882862b7-50db-497d-8ec0-9843e28bb262]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7514bedd-f01c-4af5-8f72-54ff36ef2570 tempest-GroupSnapshotsTest-1521311395 None] Group tempest-GroupSnapshotsTest-Group-710765602: creating Aug 25 06:54:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7514bedd-f01c-4af5-8f72-54ff36ef2570 tempest-GroupSnapshotsTest-1521311395 None] Group tempest-GroupSnapshotsTest-Group-710765602: created successfully Aug 25 06:54:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7514bedd-f01c-4af5-8f72-54ff36ef2570 tempest-GroupSnapshotsTest-1521311395 None] Create group completed successfully. Aug 25 06:54:16 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c Aug 25 06:54:16 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" returned: 0 in 0.412s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c Aug 25 06:54:17 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e" returned: 0 in 2.266s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_gp8sszwidevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:54:17 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Converted 112.00 MB image at 49.39 MB/s Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e 1G Aug 25 06:54:17 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" returned: 0 in 0.261s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Lock "cinder-quobyte-a03ecf3a-51f8-4d0c-b41d-e50c7e2dde1c" released by "delete_volume" :: held 0.777s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Created reservations ['cfaa9af0-7c7a-484d-ba0f-3e012fce3176'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:17 devstack cinder-volume[94460]: WARNING cinder.quota [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1562111872 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1562111872, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Created reservations ['4eb131ee-03a5-4bb4-be75-84c8a6908c5b', '2a5b4864-0c60-445c-b4be-c0f47287520f', 'ac04e067-96cd-4246-a89d-02fac48ccf31', 'ccb9c6aa-15e0-4f16-967f-419c994871df'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:17 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e 1G" returned: 0 in 0.413s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Downloaded image d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume e8e0f790-3b18-44f8-8848-d0700114969e successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 for user e5ce7ba3f71f447a9fe044107abbfb29 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Marking volume e8e0f790-3b18-44f8-8848-d0700114969e as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Copying metadata from image d970149c-5c62-44a8-b2c8-06c24c805604 to e8e0f790-3b18-44f8-8848-d0700114969e. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Creating volume glance metadata for volume e8e0f790-3b18-44f8-8848-d0700114969e backed by image d970149c-5c62-44a8-b2c8-06c24c805604 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:17 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:17 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21530206-b1ce-477e-8f9b-7917b0a7832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e0f790-3b18-44f8-8848-d0700114969e', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73ea547-7b29-4e57-93d9-840078f29d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:17 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Volume volume-e8e0f790-3b18-44f8-8848-d0700114969e (e8e0f790-3b18-44f8-8848-d0700114969e): created successfully Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73ea547-7b29-4e57-93d9-840078f29d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Flow 'volume_create_manager' (61eec942-0975-4dff-851d-a581615ac19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d413bc80-fa78-4385-9ef6-3cdb624ff70b tempest-ServerActionsTestOtherA-186498983 None] Created volume successfully. Aug 25 06:54:18 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-30daaef4-209b-486b-9170-d2f7e97459ac tempest-GroupSnapshotsV319Test-914210881 None] Delete group completed successfully. Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (6032ccc9-955e-4c64-ae34-c100c69fd852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed529b3-cdf0-400f-9cc9-c4cb36d9118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed529b3-cdf0-400f-9cc9-c4cb36d9118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-889034296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff3aa254-6b99-42b4-844a-d813d881c1f7,host='devstack@QuobyteHD#QuobyteHD',id=59552db3-45ac-4b4b-b5ea-d01d24dca15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:18Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca7b9c8-af9f-42c3-8d18-6f56541e6884),volume_type_id=8ca7b9c8-af9f-42c3-8d18-6f56541e6884)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1770a1bd-5a10-4dc0-81a8-ce66f39eb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1770a1bd-5a10-4dc0-81a8-ce66f39eb31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b39119-f79b-4d7e-a2f1-83ae0029ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b39119-f79b-4d7e-a2f1-83ae0029ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59552db3-45ac-4b4b-b5ea-d01d24dca15a', 'volume_name': 'volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c66b90e-ce36-4645-8f27-1889adf9e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c66b90e-ce36-4645-8f27-1889adf9e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04088c2f-37b2-48f9-a5b7-88ee882bce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Volume 59552db3-45ac-4b4b-b5ea-d01d24dca15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a', 'volume_size': 1} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff3aa254-6b99-42b4-844a-d813d881c1f7,created_at=2026-08-25T04:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-889034296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff3aa254-6b99-42b4-844a-d813d881c1f7,host='devstack@QuobyteHD#QuobyteHD',id=59552db3-45ac-4b4b-b5ea-d01d24dca15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:18Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca7b9c8-af9f-42c3-8d18-6f56541e6884),volume_type_id=8ca7b9c8-af9f-42c3-8d18-6f56541e6884)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Creating volume 59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:18 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:18 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a 1073741824 Aug 25 06:54:18 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Flow 'volume_create_manager' (4603af75-24b3-4b01-aa59-2971ad844a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b84cb02-9d62-48e4-aebb-3c0139badead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b84cb02-9d62-48e4-aebb-3c0139badead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-320782385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b117e15-4514-4dcc-bcf3-e32184e59a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0585c37939a342dbb238281c45c41619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:19Z,use_quota=True,user_id='7982d2b7fb4f4f8e919ec384de08ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a1039c-2c44-4f50-8852-a7cd1f3ec0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a1039c-2c44-4f50-8852-a7cd1f3ec0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb1a1eb-b70c-440d-b6f8-2019e530bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb1a1eb-b70c-440d-b6f8-2019e530bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b117e15-4514-4dcc-bcf3-e32184e59a13', 'volume_name': 'volume-8b117e15-4514-4dcc-bcf3-e32184e59a13', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15880bb8-863d-4120-bf5e-798dfc7f203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15880bb8-863d-4120-bf5e-798dfc7f203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbdb23bb-7fe3-42da-a94b-2afce87df7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Volume 8b117e15-4514-4dcc-bcf3-e32184e59a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b117e15-4514-4dcc-bcf3-e32184e59a13', 'volume_size': 1} Aug 25 06:54:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:19 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a 1073741824" returned: 0 in 0.478s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:19 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a Aug 25 06:54:19 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:19 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-320782385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b117e15-4514-4dcc-bcf3-e32184e59a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0585c37939a342dbb238281c45c41619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:19Z,use_quota=True,user_id='7982d2b7fb4f4f8e919ec384de08ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Creating volume 8b117e15-4514-4dcc-bcf3-e32184e59a13 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:19 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04088c2f-37b2-48f9-a5b7-88ee882bce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:19 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 1073741824 Aug 25 06:54:19 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d10554-93ab-4dbc-8ab1-a701c6cc4dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Volume volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a (59552db3-45ac-4b4b-b5ea-d01d24dca15a): created successfully Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d10554-93ab-4dbc-8ab1-a701c6cc4dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (6032ccc9-955e-4c64-ae34-c100c69fd852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8c4655aa-d08b-4edc-a076-1cdebf715cb8 tempest-GroupSnapshotsTest-1521311395 None] Created volume successfully. Aug 25 06:54:20 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 1073741824" returned: 0 in 0.589s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:20 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 Aug 25 06:54:20 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:20 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13" returned: 0 in 0.294s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbdb23bb-7fe3-42da-a94b-2afce87df7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b117e15-4514-4dcc-bcf3-e32184e59a13', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf78dd81-8089-4e87-a64e-cd1948330ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:20 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Volume volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 (8b117e15-4514-4dcc-bcf3-e32184e59a13): created successfully Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf78dd81-8089-4e87-a64e-cd1948330ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Flow 'volume_create_manager' (4603af75-24b3-4b01-aa59-2971ad844a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:20 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5f7f8470-6c8b-4f77-afda-a548ddf1dec1 tempest-VolumesListAdminTestJSON-1282848553 None] Created volume successfully. Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Flow 'volume_create_manager' (af0fbdd8-31f3-41bf-a4b2-804e35cdb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4969e4-dbe4-4ec4-9ce3-22089e6aa317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4969e4-dbe4-4ec4-9ce3-22089e6aa317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-193487607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0a6ac0-5a06-4141-8de2-f8cba57cb2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0585c37939a342dbb238281c45c41619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:21Z,use_quota=True,user_id='7982d2b7fb4f4f8e919ec384de08ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe525f5-da6c-41bd-b6da-48a5d4c5da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe525f5-da6c-41bd-b6da-48a5d4c5da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853fd6c7-01f3-43d5-906a-f6d318c667dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853fd6c7-01f3-43d5-906a-f6d318c667dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0a6ac0-5a06-4141-8de2-f8cba57cb2be', 'volume_name': 'volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1ce790-99fc-47b1-974d-031b1e55e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1ce790-99fc-47b1-974d-031b1e55e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5caef24-5d2d-41a7-8db4-0075f0fb8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Volume 3f0a6ac0-5a06-4141-8de2-f8cba57cb2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be', 'volume_size': 1} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-193487607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0a6ac0-5a06-4141-8de2-f8cba57cb2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0585c37939a342dbb238281c45c41619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:21Z,use_quota=True,user_id='7982d2b7fb4f4f8e919ec384de08ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Creating volume 3f0a6ac0-5a06-4141-8de2-f8cba57cb2be {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:21 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:21 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be 1073741824 Aug 25 06:54:21 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-27a56b02-d021-4375-8f31-67de7475a83a req-88f26b6a-e0e0-471d-aea5-2d81b2ccebaf tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (bd5d9b5c-1b10-422b-a3d5-07a3d34311d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9268b1d-f023-400a-a1d1-0221ef54ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9268b1d-f023-400a-a1d1-0221ef54ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-310599531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff3aa254-6b99-42b4-844a-d813d881c1f7,host='devstack@QuobyteHD#QuobyteHD',id=eb47f20d-e391-44f7-8685-8e4ac052836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:22Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca7b9c8-af9f-42c3-8d18-6f56541e6884),volume_type_id=8ca7b9c8-af9f-42c3-8d18-6f56541e6884)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1f44f5-5ad8-4912-ba49-0bda84a0a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1f44f5-5ad8-4912-ba49-0bda84a0a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b572ac98-0990-40c5-a184-ee235cc22e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b572ac98-0990-40c5-a184-ee235cc22e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb47f20d-e391-44f7-8685-8e4ac052836c', 'volume_name': 'volume-eb47f20d-e391-44f7-8685-8e4ac052836c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e642f9-b56d-46ee-9ade-85334ecd9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e642f9-b56d-46ee-9ade-85334ecd9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e84ee1d-fabd-4458-8957-21550b86223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:22 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Volume eb47f20d-e391-44f7-8685-8e4ac052836c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb47f20d-e391-44f7-8685-8e4ac052836c', 'volume_size': 1} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:22 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be 1073741824" returned: 0 in 0.676s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:22 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be Aug 25 06:54:22 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:22 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be" returned: 0 in 0.330s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-27a56b02-d021-4375-8f31-67de7475a83a req-88f26b6a-e0e0-471d-aea5-2d81b2ccebaf tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.731s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-27a56b02-d021-4375-8f31-67de7475a83a req-88f26b6a-e0e0-471d-aea5-2d81b2ccebaf tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff3aa254-6b99-42b4-844a-d813d881c1f7,created_at=2026-08-25T04:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-310599531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff3aa254-6b99-42b4-844a-d813d881c1f7,host='devstack@QuobyteHD#QuobyteHD',id=eb47f20d-e391-44f7-8685-8e4ac052836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:22Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca7b9c8-af9f-42c3-8d18-6f56541e6884),volume_type_id=8ca7b9c8-af9f-42c3-8d18-6f56541e6884)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Creating volume eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:22 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5caef24-5d2d-41a7-8db4-0075f0fb8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f95ceda-8d6d-4c46-b2e6-4a39c52033a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:22 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c 1073741824 Aug 25 06:54:22 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:22 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Volume volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be (3f0a6ac0-5a06-4141-8de2-f8cba57cb2be): created successfully Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f95ceda-8d6d-4c46-b2e6-4a39c52033a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Flow 'volume_create_manager' (af0fbdd8-31f3-41bf-a4b2-804e35cdb38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-27a56b02-d021-4375-8f31-67de7475a83a req-88f26b6a-e0e0-471d-aea5-2d81b2ccebaf tempest-ServerActionsTestOtherA-186498983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-e8e0f790-3b18-44f8-8848-d0700114969e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13bfb0be-023e-4bcb-90de-bed8a035a1f4', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:54:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c54c55f6-abd5-4c4e-9978-70374260a794 tempest-VolumesListAdminTestJSON-1282848553 None] Created volume successfully. Aug 25 06:54:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-27a56b02-d021-4375-8f31-67de7475a83a req-88f26b6a-e0e0-471d-aea5-2d81b2ccebaf tempest-ServerActionsTestOtherA-186498983 None] attachment_update completed successfully. Aug 25 06:54:23 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c 1073741824" returned: 0 in 0.573s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:23 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c Aug 25 06:54:23 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:23 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c" returned: 0 in 0.392s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e84ee1d-fabd-4458-8957-21550b86223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb47f20d-e391-44f7-8685-8e4ac052836c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025c04d5-425e-43bf-b674-db6b857eadb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:23 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Volume volume-eb47f20d-e391-44f7-8685-8e4ac052836c (eb47f20d-e391-44f7-8685-8e4ac052836c): created successfully Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025c04d5-425e-43bf-b674-db6b857eadb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (bd5d9b5c-1b10-422b-a3d5-07a3d34311d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b29674ed-ad69-4780-b94b-1086fbb14fcb tempest-GroupSnapshotsTest-1521311395 None] Created volume successfully. Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Flow 'volume_create_manager' (223e88a6-42e0-45c5-b785-1892fd592b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee7cbf2-9908-4006-aeed-859c2c6d0c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee7cbf2-9908-4006-aeed-859c2c6d0c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1712878520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1259ff8d-dbd3-49fe-9dbe-62044af82ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0585c37939a342dbb238281c45c41619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:24Z,use_quota=True,user_id='7982d2b7fb4f4f8e919ec384de08ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d341fa27-0fbb-4c10-bfc3-3f8e20c7d2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d341fa27-0fbb-4c10-bfc3-3f8e20c7d2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3ab1e6-4055-45b6-9060-15fd05219d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3ab1e6-4055-45b6-9060-15fd05219d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1259ff8d-dbd3-49fe-9dbe-62044af82ae2', 'volume_name': 'volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f279613-8af0-494f-9de7-aa956d75c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f279613-8af0-494f-9de7-aa956d75c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5158e6a1-ae5e-46f6-9b47-2d17b744a172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:24 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Volume 1259ff8d-dbd3-49fe-9dbe-62044af82ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2', 'volume_size': 1} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1712878520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1259ff8d-dbd3-49fe-9dbe-62044af82ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0585c37939a342dbb238281c45c41619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:24Z,use_quota=True,user_id='7982d2b7fb4f4f8e919ec384de08ee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Creating volume 1259ff8d-dbd3-49fe-9dbe-62044af82ae2 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:24 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:24 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 1073741824 Aug 25 06:54:24 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-71328b1f-b0f7-48d2-a5c6-860e757ec564 tempest-GroupSnapshotsTest-1521311395 None] Update group completed successfully. Aug 25 06:54:24 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 1073741824" returned: 0 in 0.645s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:24 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 Aug 25 06:54:24 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:25 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2" returned: 0 in 0.515s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5158e6a1-ae5e-46f6-9b47-2d17b744a172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d52a230-ea5f-4c07-ae58-8f31b008a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:25 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Volume volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 (1259ff8d-dbd3-49fe-9dbe-62044af82ae2): created successfully Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d52a230-ea5f-4c07-ae58-8f31b008a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Flow 'volume_create_manager' (223e88a6-42e0-45c5-b785-1892fd592b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1e327297-d5f8-4e9b-862b-8bb0e5fa4a0d tempest-VolumesListAdminTestJSON-1282848553 None] Created volume successfully. Aug 25 06:54:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5c75b92d-12e1-4dde-9cc6-3f881593c4ea tempest-GroupSnapshotsTest-1521311395 None] Update group completed successfully. Aug 25 06:54:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fff846d6-b808-42f0-a592-ec4134bbf823 tempest-GroupSnapshotsTest-1521311395 None] Update group completed successfully. Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Flow 'volume_create_manager' (d6bf72d4-c23f-4c28-967e-79faf2aa37c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb9d8df-f3d5-4586-bef2-3b8a3ed76b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb9d8df-f3d5-4586-bef2-3b8a3ed76b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ff98bf-6016-4758-886b-d7629894181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26116ea620904581888452e5d688b284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:27Z,use_quota=True,user_id='bf936a510e7e4ee78e5fc816ef71832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094f4e3f-0f0b-455f-84f7-91399acaab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094f4e3f-0f0b-455f-84f7-91399acaab81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87450feb-7310-4a8e-a404-d8901689eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87450feb-7310-4a8e-a404-d8901689eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ff98bf-6016-4758-886b-d7629894181e', 'volume_name': 'volume-b8ff98bf-6016-4758-886b-d7629894181e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00205023-0735-425a-bb5f-d868eaa2f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00205023-0735-425a-bb5f-d868eaa2f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9b4143-c8e5-49ea-b811-a2e1e5761515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:27 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Volume b8ff98bf-6016-4758-886b-d7629894181e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ff98bf-6016-4758-886b-d7629894181e', 'volume_size': 1} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ff98bf-6016-4758-886b-d7629894181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26116ea620904581888452e5d688b284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:27Z,use_quota=True,user_id='bf936a510e7e4ee78e5fc816ef71832d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Creating volume b8ff98bf-6016-4758-886b-d7629894181e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:27 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:27 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e 1073741824 Aug 25 06:54:27 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:27 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e 1073741824" returned: 0 in 0.564s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:28 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e Aug 25 06:54:28 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-31ec953d-3bc3-48f4-be36-7e6b4b6afcdd tempest-GroupSnapshotsTest-1521311395 None] Update group completed successfully. Aug 25 06:54:28 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e" returned: 0 in 0.517s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9b4143-c8e5-49ea-b811-a2e1e5761515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ff98bf-6016-4758-886b-d7629894181e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f075ed-5c23-4473-9ca9-0d4a771fca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:28 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Volume volume-b8ff98bf-6016-4758-886b-d7629894181e (b8ff98bf-6016-4758-886b-d7629894181e): created successfully Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f075ed-5c23-4473-9ca9-0d4a771fca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Flow 'volume_create_manager' (d6bf72d4-c23f-4c28-967e-79faf2aa37c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e17d4c01-e1cd-45de-9825-8fc943f7e475 tempest-VolumesListAdminTestJSON-389485858 None] Created volume successfully. Aug 25 06:54:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Acquiring lock "cinder-b8ff98bf-6016-4758-886b-d7629894181e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Lock "cinder-b8ff98bf-6016-4758-886b-d7629894181e-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Acquiring lock "cinder-quobyte-b8ff98bf-6016-4758-886b-d7629894181e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Lock "cinder-quobyte-b8ff98bf-6016-4758-886b-d7629894181e" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd21f9-ee19-414e-bb7f-168bc9203443]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "cinder-1259ff8d-dbd3-49fe-9dbe-62044af82ae2-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] GroupSnapshot df9f9206-4f67-4d37-ab0c-98a625f47df9: creating. Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-1259ff8d-dbd3-49fe-9dbe-62044af82ae2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Group snapshot df9f9206-4f67-4d37-ab0c-98a625f47df9: creating. {{(pid=94460) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4197}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "cinder-quobyte-1259ff8d-dbd3-49fe-9dbe-62044af82ae2" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Creating offline snapshot ac4d761d-8e61-4a82-bb94-67a1a2cfe71c of volume eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-quobyte-1259ff8d-dbd3-49fe-9dbe-62044af82ae2" acquired by "delete_volume" :: waited 0.049s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:30 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e Aug 25 06:54:30 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ae54f-16e2-4018-9f96-7fed538d66ea]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c7935c-e36d-4e14-8d71-65f14c6bd0f3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:30 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 Aug 25 06:54:30 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:30 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c Aug 25 06:54:30 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:30 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e" returned: 0 in 0.934s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:31 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e Aug 25 06:54:31 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:31 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c" returned: 0 in 0.909s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:31 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c 1G Aug 25 06:54:31 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:31 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2" returned: 0 in 0.956s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:31 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2 Aug 25 06:54:31 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:31 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b8ff98bf-6016-4758-886b-d7629894181e" returned: 0 in 0.662s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Lock "cinder-quobyte-b8ff98bf-6016-4758-886b-d7629894181e" released by "delete_volume" :: held 1.691s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:31 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1259ff8d-dbd3-49fe-9dbe-62044af82ae2" returned: 0 in 0.384s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:31 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:31 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-quobyte-1259ff8d-dbd3-49fe-9dbe-62044af82ae2" released by "delete_volume" :: held 1.466s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Created reservations ['330de527-abb3-42da-824a-37829de93032', '980dbab0-f90d-42ab-8dd2-3288c9810046', '4845b470-ce00-4448-8924-8a4e2aa5258e', 'ea86de02-8b59-4826-98b1-6a3f81a85d87'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:32 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:32 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Created reservations ['de25ab2f-3d41-40ba-93a7-f9f0fabe11c3', '6705a7f7-9ee2-4415-8294-2ed2b1f32332', '1ec1e680-2c0e-4f2e-ab53-5b88d38d0611', 'fa1556f8-7be1-4729-afd3-e9445993ed48'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:32 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:32 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:32 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:32 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.622s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.409s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 28 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:54:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Deleted volume successfully. Aug 25 06:54:32 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c 1G" returned: 0 in 1.128s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb47f20d-e391-44f7-8685-8e4ac052836c -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:32 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb47f20d-e391-44f7-8685-8e4ac052836c -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c Aug 25 06:54:32 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f027f5ab-52bb-44d8-9497-c7757c95dbd5 tempest-VolumesListAdminTestJSON-389485858 None] Lock "cinder-b8ff98bf-6016-4758-886b-d7629894181e-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:32 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.684s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Deleted volume successfully. Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-798ffd60-77e7-4154-92b7-637b66884a72 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-1259ff8d-dbd3-49fe-9dbe-62044af82ae2-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:32 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb47f20d-e391-44f7-8685-8e4ac052836c -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" returned: 0 in 0.507s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:32 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:33 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c Aug 25 06:54:33 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "cinder-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:33 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" returned: 0 in 0.635s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "cinder-quobyte-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-quobyte-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be" acquired by "delete_volume" :: waited 0.057s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:33 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info Aug 25 06:54:33 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeccf65-8383-4f28-82ae-7b0f03f1440b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:33 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be Aug 25 06:54:33 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:34 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info" returned: 0 in 0.607s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:34 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:34 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be" returned: 0 in 0.553s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:34 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info Aug 25 06:54:34 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:34 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be Aug 25 06:54:34 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:34 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be" returned: 0 in 0.363s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:34 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.info" returned: 0 in 0.417s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.384s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-quobyte-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be" released by "delete_volume" :: held 1.060s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Creating offline snapshot c9601e89-c3a4-44e6-bcaf-ba2bc58dcced of volume 59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf3d78-f986-45ae-8b44-d948f231410f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:34 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Created reservations ['fae127fe-7216-4d63-b767-3bf8863ac14a', 'd4c33358-ae9e-4c1a-94cf-38a5ae4eb81e', '50486e9d-7418-4fea-a89a-9d0ccc6bb023', '65bfe7d3-e1ba-449b-9c50-b445329bf84a'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:35 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a Aug 25 06:54:35 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:35 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:35 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:35 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.482s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Deleted volume successfully. Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a16c3f05-3bbd-4e89-9d38-003f8876c272 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-3f0a6ac0-5a06-4141-8de2-f8cba57cb2be-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:35 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a" returned: 0 in 0.820s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:35 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced 1G Aug 25 06:54:35 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "cinder-8b117e15-4514-4dcc-bcf3-e32184e59a13-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-8b117e15-4514-4dcc-bcf3-e32184e59a13-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=148,cinder:SELECT=149,cinder:DELETE=12,cinder:INSERT=39 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=155,cinder:UPDATE=166,cinder:INSERT=42,cinder:DELETE=7 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "cinder-quobyte-8b117e15-4514-4dcc-bcf3-e32184e59a13" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-quobyte-8b117e15-4514-4dcc-bcf3-e32184e59a13" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[feecd070-2170-444b-ab9f-62c253ccef19]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:36 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced 1G" returned: 0 in 0.688s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:36 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 Aug 25 06:54:36 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:36 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced Aug 25 06:54:36 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:36 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13" returned: 0 in 0.498s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:36 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13 Aug 25 06:54:36 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:36 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" returned: 0 in 0.523s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:36 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:36 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced Aug 25 06:54:36 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Flow 'volume_create_manager' (e131bc72-5cd2-4150-954d-a59885ccfa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4299d9-54e1-4e54-9630-ea850d0114f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4299d9-54e1-4e54-9630-ea850d0114f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2092497097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532e1534-bff5-4cf0-8fc0-da1d4524458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2465a32bdd54ecfaa1385fbc721d5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:37Z,use_quota=True,user_id='85f6331b8cca4b27a20a3c1fab06a9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccc0855-e759-47ad-b4d4-075c97302832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccc0855-e759-47ad-b4d4-075c97302832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bf3431-af78-46bd-a5c7-9e19fecac8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bf3431-af78-46bd-a5c7-9e19fecac8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532e1534-bff5-4cf0-8fc0-da1d4524458b', 'volume_name': 'volume-532e1534-bff5-4cf0-8fc0-da1d4524458b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107e7f83-e377-4712-943f-5e6d907cb90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107e7f83-e377-4712-943f-5e6d907cb90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc84f8-20be-4ff3-a09b-4b2f71c06458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Volume 532e1534-bff5-4cf0-8fc0-da1d4524458b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532e1534-bff5-4cf0-8fc0-da1d4524458b', 'volume_size': 1} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:37 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8b117e15-4514-4dcc-bcf3-e32184e59a13" returned: 0 in 0.399s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-quobyte-8b117e15-4514-4dcc-bcf3-e32184e59a13" released by "delete_volume" :: held 0.973s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Created reservations ['87dc86d2-db7d-4a40-ad75-94b2fb8ff3f6', '26a6ef75-ec44-4a2c-a780-b8b5dd5ff128', 'f28b8812-e538-40d3-9f6a-06fcd893359c', 'c9b29c08-7541-4c1e-882d-2f775a556c53'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:37 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" returned: 0 in 0.396s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:37 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info Aug 25 06:54:37 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:37 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:37 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:37 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info" returned: 0 in 0.413s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:37 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:37 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.391s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:37 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info Aug 25 06:54:37 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Deleted volume successfully. Aug 25 06:54:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b8a925fd-7514-4c78-a228-904afaba0bf4 tempest-VolumesListAdminTestJSON-1282848553 None] Lock "cinder-8b117e15-4514-4dcc-bcf3-e32184e59a13-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:38 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.info" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2092497097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532e1534-bff5-4cf0-8fc0-da1d4524458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2465a32bdd54ecfaa1385fbc721d5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:37Z,use_quota=True,user_id='85f6331b8cca4b27a20a3c1fab06a9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Creating volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:38 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:38 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b 1073741824 Aug 25 06:54:38 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:38 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-810efd85-7095-48d6-87cc-e5ac2859e582 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot df9f9206-4f67-4d37-ab0c-98a625f47df9: created successfully Aug 25 06:54:38 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b 1073741824" returned: 0 in 0.631s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:38 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b Aug 25 06:54:38 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:39 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b" returned: 0 in 0.565s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc84f8-20be-4ff3-a09b-4b2f71c06458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532e1534-bff5-4cf0-8fc0-da1d4524458b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69604b1a-b287-4bed-be17-c208a50aff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot df9f9206-4f67-4d37-ab0c-98a625f47df9: deleting Aug 25 06:54:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Volume volume-532e1534-bff5-4cf0-8fc0-da1d4524458b (532e1534-bff5-4cf0-8fc0-da1d4524458b): created successfully Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69604b1a-b287-4bed-be17-c208a50aff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Flow 'volume_create_manager' (e131bc72-5cd2-4150-954d-a59885ccfa33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot df9f9206-4f67-4d37-ab0c-98a625f47df9: deleting {{(pid=94460) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4372}} Aug 25 06:54:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bed6bb6a-72ed-4623-9f71-1d801a5526a9 tempest-SnapshotsActionsTest-2010783552 None] Created volume successfully. Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-eb47f20d-e391-44f7-8685-8e4ac052836c" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-eb47f20d-e391-44f7-8685-8e4ac052836c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Deleting offline snapshot ac4d761d-8e61-4a82-bb94-67a1a2cfe71c of volume eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] snapshot_file for this snap is: volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a28d0c7-d35c-490b-a7f8-3f12dba7a3b9]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:39 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c Aug 25 06:54:39 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:40 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" returned: 0 in 0.579s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb47f20d-e391-44f7-8685-8e4ac052836c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf469a-b0a2-40f2-b3c1-fdbb7586ae0f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:40 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c Aug 25 06:54:40 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Creating offline snapshot 1ed4dfdf-3598-49b7-8437-d5298b314af3 of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e1cd5-b1f4-46b9-b671-842e80963d62]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:40 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b Aug 25 06:54:40 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:41 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c" returned: 0 in 0.680s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:41 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c Aug 25 06:54:41 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:41 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b" returned: 0 in 0.678s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:41 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 1G Aug 25 06:54:41 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-4aafc033-b17d-4591-948b-503c77c57fcf tempest-ServerActionsTestOtherA-186498983 None] Terminate volume connection completed successfully. Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-4aafc033-b17d-4591-948b-503c77c57fcf tempest-ServerActionsTestOtherA-186498983 None] Deleting attachment 13bfb0be-023e-4bcb-90de-bed8a035a1f4. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:54:41 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" returned: 0 in 0.508s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:41 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c Aug 25 06:54:41 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:41 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c.ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" returned: 0 in 0.298s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-ac4d761d-8e61-4a82-bb94-67a1a2cfe71c" released by "_delete_snapshot" :: held 2.229s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-eb47f20d-e391-44f7-8685-8e4ac052836c" released by "delete_snapshot" :: held 2.267s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-59552db3-45ac-4b4b-b5ea-d01d24dca15a" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-59552db3-45ac-4b4b-b5ea-d01d24dca15a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:41 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 1G" returned: 0 in 0.662s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:41 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:41 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Deleting offline snapshot c9601e89-c3a4-44e6-bcaf-ba2bc58dcced of volume 59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] snapshot_file for this snap is: volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb0d26-7379-4093-9383-238c4e295271]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:42 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced Aug 25 06:54:42 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:42 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.420s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:42 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 is being set with open permissions: ugo+rw Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:42 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:42 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:42 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" returned: 0 in 0.574s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e791e71-1a35-49a3-a77b-b0cb5572915b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:42 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.412s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:42 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a Aug 25 06:54:42 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:42 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info Aug 25 06:54:42 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:43 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info" returned: 0 in 0.317s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:43 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info is being set with open permissions: ugo+rw Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:43 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a" returned: 0 in 0.481s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:43 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info Aug 25 06:54:43 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:43 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced Aug 25 06:54:43 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-65c922eb-2007-4ddc-ad5f-c488f20f3d30 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:43 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.info" returned: 0 in 0.372s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-65c922eb-2007-4ddc-ad5f-c488f20f3d30 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.110s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-65c922eb-2007-4ddc-ad5f-c488f20f3d30 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0fbec230-ec56-4485-b178-928790e82b4e tempest-SnapshotsActionsTest-2010783552 None] Create snapshot completed successfully Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-65c922eb-2007-4ddc-ad5f-c488f20f3d30 tempest-ServerActionsTestOtherA-186498983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-e8e0f790-3b18-44f8-8848-d0700114969e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '576a13ea-0673-460e-925d-85234f16658d', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:54:43 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" returned: 0 in 0.502s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:43 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced Aug 25 06:54:43 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-08da2e04-8885-40dc-864e-c3d64ad88dd0 req-65c922eb-2007-4ddc-ad5f-c488f20f3d30 tempest-ServerActionsTestOtherA-186498983 None] attachment_update completed successfully. Aug 25 06:54:43 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a.c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" returned: 0 in 0.329s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-c9601e89-c3a4-44e6-bcaf-ba2bc58dcced" released by "_delete_snapshot" :: held 2.066s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-59552db3-45ac-4b4b-b5ea-d01d24dca15a" released by "delete_snapshot" :: held 2.127s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:44 devstack cinder-volume[94460]: WARNING cinder.quota [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1116232298 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1116232298, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:44 devstack cinder-volume[94460]: WARNING cinder.quota [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1116232298 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1116232298, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['3176aaa6-f69a-48f9-8ded-0a2aceb149d0', '8b6b5b8e-9a25-4e7a-93ef-da7d878e7772', '5d2da76a-0b75-4ff3-a3e4-153f27ddb2c8', 'c50b86da-8089-425b-b073-98bb8b9ac074'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['ae156e7a-7688-48e2-98f2-ee0c59011578', '61629954-b51b-4cf6-9e15-38efb84f8a95', 'cd07f865-38ca-454d-ad5c-839a4494d45a', 'd7b91310-1491-4bb7-a2a9-754b4fb8b977'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-efec782d-f49c-4a86-9820-4d9b46459628 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot df9f9206-4f67-4d37-ab0c-98a625f47df9: deleted successfully Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Creating offline snapshot a43ef5de-6742-4fb0-b43d-49978d0d18f5 of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef3f68-4794-49dd-83dd-d9cbea5c5cc6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:45 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:45 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:45 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.527s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:45 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 1G Aug 25 06:54:45 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-59552db3-45ac-4b4b-b5ea-d01d24dca15a" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-59552db3-45ac-4b4b-b5ea-d01d24dca15a" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[91719f6d-2693-46b4-bbe7-abb5fb08e5b3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:46 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 1G" returned: 0 in 0.590s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:46 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 Aug 25 06:54:46 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:46 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a Aug 25 06:54:46 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:46 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a" returned: 0 in 0.480s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:46 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5" returned: 0 in 0.403s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:46 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 is being set with open permissions: ugo+rw Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:46 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a Aug 25 06:54:46 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:46 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 Aug 25 06:54:46 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:46 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59552db3-45ac-4b4b-b5ea-d01d24dca15a" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-59552db3-45ac-4b4b-b5ea-d01d24dca15a" released by "delete_volume" :: held 0.892s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-eb47f20d-e391-44f7-8685-8e4ac052836c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:46 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5" returned: 0 in 0.364s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-eb47f20d-e391-44f7-8685-8e4ac052836c" acquired by "delete_volume" :: waited 0.041s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dedc5d-267f-410d-a037-59faad341fc4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-62663a15-13d9-4317-8d18-17192f0add82 tempest-SnapshotsActionsTest-2010783552 None] Create snapshot completed successfully Aug 25 06:54:47 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c Aug 25 06:54:47 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:47 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c" returned: 0 in 0.570s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:47 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c Aug 25 06:54:47 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:47 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb47f20d-e391-44f7-8685-8e4ac052836c" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-eb47f20d-e391-44f7-8685-8e4ac052836c" released by "delete_volume" :: held 1.006s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['7fadc0f6-4cd2-459c-9793-1ca53fff13b9'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:48 devstack cinder-volume[94460]: WARNING cinder.quota [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1116232298 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1116232298, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['999161ce-c0be-4149-b173-fd38e67c1352', '9cfb32d2-220b-4be1-8c6e-0662df289ba4', '3bb88350-8e34-46e4-b244-910540dd6c5e', '23117d66-2d9d-42a7-abfd-e0da09bc1c7f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-a43ef5de-6742-4fb0-b43d-49978d0d18f5-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-a43ef5de-6742-4fb0-b43d-49978d0d18f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-a43ef5de-6742-4fb0-b43d-49978d0d18f5" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-a43ef5de-6742-4fb0-b43d-49978d0d18f5" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Deleting offline snapshot a43ef5de-6742-4fb0-b43d-49978d0d18f5 of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] snapshot_file for this snap is: volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['f6bdcf38-36fb-4c50-a957-d49419e00182', '48336c40-7a69-4b6e-b925-620f3a48c545', '6621395e-4ed6-4a5d-8bff-2323077d99f1', '2bdf5cf5-284c-4730-b411-8fbea3dd29ee'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5243f30-cab5-434a-b845-07e1f7ac0a58]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:48 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 Aug 25 06:54:48 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:48 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:48 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:49 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5" returned: 0 in 0.665s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1efdb38-38e0-4f9e-bd4b-8936700631cf]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:49 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.488s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c6f76ddb-5be3-4bad-af6f-202dfed7ee37 tempest-GroupSnapshotsTest-1521311395 None] Delete group completed successfully. Aug 25 06:54:49 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:49 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:49 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.609s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:49 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 Aug 25 06:54:49 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Flow 'volume_create_manager' (6ea23f7f-bcfe-43a9-a933-c5da4dc52efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ece11d-b888-427d-8c47-571ea1f32c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ece11d-b888-427d-8c47-571ea1f32c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1176648011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d47fbd-2966-4a10-9947-ac4fe2407803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8427ff13a7c640babfd868d33ac8633a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:50Z,use_quota=True,user_id='bc4ae17cd56349ccba7c5f59771620a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4566b15c-8feb-4b9d-89de-3e4b0231cf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4566b15c-8feb-4b9d-89de-3e4b0231cf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af17b76e-7a28-495d-bde4-79b7f3fd3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af17b76e-7a28-495d-bde4-79b7f3fd3abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d47fbd-2966-4a10-9947-ac4fe2407803', 'volume_name': 'volume-72d47fbd-2966-4a10-9947-ac4fe2407803', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dcfdfa-41b3-4500-8a6b-b507ed822662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dcfdfa-41b3-4500-8a6b-b507ed822662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd60563-3bb6-4605-a0d9-b8778d79af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Volume 72d47fbd-2966-4a10-9947-ac4fe2407803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d47fbd-2966-4a10-9947-ac4fe2407803', 'volume_size': 1} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1176648011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d47fbd-2966-4a10-9947-ac4fe2407803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8427ff13a7c640babfd868d33ac8633a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:50Z,use_quota=True,user_id='bc4ae17cd56349ccba7c5f59771620a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Creating volume 72d47fbd-2966-4a10-9947-ac4fe2407803 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:50 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:50 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 1073741824 Aug 25 06:54:50 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e5559422-8ae9-4657-90de-f09668516b02 tempest-GroupSnapshotsTest-1521311395 None] Group tempest-GroupSnapshotsTest-Group-1356316743: creating Aug 25 06:54:50 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e5559422-8ae9-4657-90de-f09668516b02 tempest-GroupSnapshotsTest-1521311395 None] Group tempest-GroupSnapshotsTest-Group-1356316743: created successfully Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5" returned: 0 in 0.670s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e5559422-8ae9-4657-90de-f09668516b02 tempest-GroupSnapshotsTest-1521311395 None] Create group completed successfully. Aug 25 06:54:50 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5 Aug 25 06:54:50 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:50 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.a43ef5de-6742-4fb0-b43d-49978d0d18f5" returned: 0 in 0.486s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-a43ef5de-6742-4fb0-b43d-49978d0d18f5" released by "_delete_snapshot" :: held 2.615s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:50 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 1073741824" returned: 0 in 0.720s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" released by "delete_snapshot" :: held 2.674s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:51 devstack cinder-volume[94460]: WARNING cinder.quota [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:54:51 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 Aug 25 06:54:51 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Created reservations ['a76c9ff8-af9c-479c-ac16-349041dde97b', 'e9a942bc-917b-4e0e-b09b-27c080b95b03', '03c7fe9b-0249-4467-b4e5-6c174598c17b', 'd3f94b7a-7472-45c4-ace9-5a91ba238d1d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Delete snapshot completed successfully. Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fcfde118-69c3-42a7-92f8-ec611e00a374 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-a43ef5de-6742-4fb0-b43d-49978d0d18f5-delete_snapshot" released by "delete_snapshot" :: held 2.905s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:51 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803" returned: 0 in 0.326s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd60563-3bb6-4605-a0d9-b8778d79af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d47fbd-2966-4a10-9947-ac4fe2407803', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f4ef89-a70d-4d68-8d0b-ffde0a9e3d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Volume volume-72d47fbd-2966-4a10-9947-ac4fe2407803 (72d47fbd-2966-4a10-9947-ac4fe2407803): created successfully Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f4ef89-a70d-4d68-8d0b-ffde0a9e3d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Flow 'volume_create_manager' (6ea23f7f-bcfe-43a9-a933-c5da4dc52efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1d3d6512-5b68-4a26-9f98-4490b7e573a5 tempest-AbsoluteLimitsTests-1236650758 None] Created volume successfully. Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Acquiring lock "cinder-72d47fbd-2966-4a10-9947-ac4fe2407803-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Lock "cinder-72d47fbd-2966-4a10-9947-ac4fe2407803-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (4ae2f656-921d-48e9-b31a-6d99fa5dd285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785a90f2-edc2-440f-8dc8-cfb3e4dd4697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Creating offline snapshot b4180fcb-996c-4c51-a260-811ebe3804df of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785a90f2-edc2-440f-8dc8-cfb3e4dd4697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2107301977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a2ceffe-ec03-4d1a-b910-c8e6a5d7082a,host='devstack@QuobyteHD#QuobyteHD',id=af56dfb0-b61c-4978-a72c-d032273f84de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:52Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8dc9b9e-611e-4ba9-ace2-c86cb84cafa9),volume_type_id=b8dc9b9e-611e-4ba9-ace2-c86cb84cafa9)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b37448f-ae7a-4d14-9f6c-8026fc58fe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b37448f-ae7a-4d14-9f6c-8026fc58fe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d260b7cb-12d5-4ada-8621-c77462ce5070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d260b7cb-12d5-4ada-8621-c77462ce5070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af56dfb0-b61c-4978-a72c-d032273f84de', 'volume_name': 'volume-af56dfb0-b61c-4978-a72c-d032273f84de', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97322bb-1f2e-40d6-87dd-6358fbc9c36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97322bb-1f2e-40d6-87dd-6358fbc9c36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92f3ec4-65dd-4a8a-b885-eeb23b3ed8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:52 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Volume af56dfb0-b61c-4978-a72c-d032273f84de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af56dfb0-b61c-4978-a72c-d032273f84de', 'volume_size': 1} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[65179537-ecfe-4b32-b8c0-e268770fd15c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Acquiring lock "cinder-quobyte-72d47fbd-2966-4a10-9947-ac4fe2407803" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Lock "cinder-quobyte-72d47fbd-2966-4a10-9947-ac4fe2407803" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1fd7e-22a5-41ef-8df3-2b361d4f2c93]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:52 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:52 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:52 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 Aug 25 06:54:52 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:53 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.428s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:53 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df 1G Aug 25 06:54:53 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:53 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803" returned: 0 in 0.421s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:53 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803 Aug 25 06:54:53 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:53 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-72d47fbd-2966-4a10-9947-ac4fe2407803" returned: 0 in 0.278s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Lock "cinder-quobyte-72d47fbd-2966-4a10-9947-ac4fe2407803" released by "delete_volume" :: held 0.754s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Created reservations ['80aa76a8-fa7b-44ff-b19c-18ece85d5fcd', 'bf5535c0-f51a-415c-a92d-61fd73277328', '666ba586-ab00-4040-b453-9bd00dc01706', '1e4e9198-4b02-4a28-b79d-ce03796b35c0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:53 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df 1G" returned: 0 in 0.539s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:53 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:54:53 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:53 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df Aug 25 06:54:53 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:53 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.247s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:54:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Deleted volume successfully. Aug 25 06:54:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ac5e5352-de47-434a-b9c5-e9795e87165f tempest-AbsoluteLimitsTests-1236650758 None] Lock "cinder-72d47fbd-2966-4a10-9947-ac4fe2407803-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:54 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df" returned: 0 in 0.327s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:54 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df is being set with open permissions: ugo+rw Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:54 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df Aug 25 06:54:54 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:54 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df" returned: 0 in 0.256s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.593s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a2ceffe-ec03-4d1a-b910-c8e6a5d7082a,created_at=2026-08-25T04:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2107301977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a2ceffe-ec03-4d1a-b910-c8e6a5d7082a,host='devstack@QuobyteHD#QuobyteHD',id=af56dfb0-b61c-4978-a72c-d032273f84de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360fc17883e14ff1b3854855750ce66e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:54:52Z,use_quota=True,user_id='e3e7630aafb3436797a32a7719ac6f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8dc9b9e-611e-4ba9-ace2-c86cb84cafa9),volume_type_id=b8dc9b9e-611e-4ba9-ace2-c86cb84cafa9)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Creating volume af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:54:54 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:54 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de 1073741824 Aug 25 06:54:54 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-efe6b897-fea8-4b7f-baf4-e57b20e40745 tempest-SnapshotsActionsTest-2010783552 None] Create snapshot completed successfully Aug 25 06:54:54 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de 1073741824" returned: 0 in 0.449s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:54 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de Aug 25 06:54:54 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:55 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92f3ec4-65dd-4a8a-b885-eeb23b3ed8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af56dfb0-b61c-4978-a72c-d032273f84de', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13109e54-3479-4674-9800-eebbf93b76f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:54:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Volume volume-af56dfb0-b61c-4978-a72c-d032273f84de (af56dfb0-b61c-4978-a72c-d032273f84de): created successfully Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13109e54-3479-4674-9800-eebbf93b76f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Flow 'volume_create_manager' (4ae2f656-921d-48e9-b31a-6d99fa5dd285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:54:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8408aecd-18bd-4b75-b09d-099d6517c9b8 tempest-GroupSnapshotsTest-1521311395 None] Created volume successfully. Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-b4180fcb-996c-4c51-a260-811ebe3804df-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-b4180fcb-996c-4c51-a260-811ebe3804df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-b4180fcb-996c-4c51-a260-811ebe3804df" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-b4180fcb-996c-4c51-a260-811ebe3804df" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Deleting offline snapshot b4180fcb-996c-4c51-a260-811ebe3804df of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] snapshot_file for this snap is: volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ba0f7a-16ed-4ba2-89e8-35bcbb0692bd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:55 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df Aug 25 06:54:55 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:55 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df" returned: 0 in 0.487s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f757713-7c8f-4f25-a91d-758e8d00c63f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:56 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] GroupSnapshot 200de236-a252-47ed-9d0e-c5222539c826: creating. Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Group snapshot 200de236-a252-47ed-9d0e-c5222539c826: creating. {{(pid=94460) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4197}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Creating offline snapshot 3a6bac10-7690-4fe2-b723-f26239fabf91 of volume af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd41fce-1119-4cdc-bf33-b41873a8ce48]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.431s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df Aug 25 06:54:56 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:56 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de Aug 25 06:54:56 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:56 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de" returned: 0 in 0.495s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 1G Aug 25 06:54:56 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:56 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df" returned: 0 in 0.532s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:56 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df Aug 25 06:54:56 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:57 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.b4180fcb-996c-4c51-a260-811ebe3804df" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-b4180fcb-996c-4c51-a260-811ebe3804df" released by "_delete_snapshot" :: held 1.916s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" released by "delete_snapshot" :: held 1.949s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Created reservations ['ec39acb4-9bd4-4e7e-b819-a4b425085b46', '7893238d-83ae-4207-befe-7d6c39a6fc7d', '6c0686cf-a0e9-49e8-8d51-eda13a1ed477', '027d7ad2-dc15-485e-9d9a-f3ecd7df8f58'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:54:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Delete snapshot completed successfully. Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-db8aaf2a-4b11-4f7d-94b3-f788d87d3b9b tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-b4180fcb-996c-4c51-a260-811ebe3804df-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:54:57 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 1G" returned: 0 in 0.677s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af56dfb0-b61c-4978-a72c-d032273f84de -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:57 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af56dfb0-b61c-4978-a72c-d032273f84de -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 Aug 25 06:54:57 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:57 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af56dfb0-b61c-4978-a72c-d032273f84de -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:57 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:57 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 Aug 25 06:54:57 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:58 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:58 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info Aug 25 06:54:58 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:58 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info" returned: 0 in 0.269s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:58 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:58 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info Aug 25 06:54:58 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:58 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.info" returned: 0 in 0.364s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:54:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-38c20df6-b102-4d07-8947-b69d48b4b580 tempest-GroupSnapshotsTest-1521311395 None] group_snapshot 200de236-a252-47ed-9d0e-c5222539c826: created successfully Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Creating offline snapshot 9be355be-39be-4177-a132-6512c639077b of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a9e4b-43a5-440f-9dde-6c246f81670e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:59 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:54:59 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:59 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.439s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:54:59 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b 1G Aug 25 06:54:59 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:54:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] group_snapshot 200de236-a252-47ed-9d0e-c5222539c826: deleting Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] group_snapshot 200de236-a252-47ed-9d0e-c5222539c826: deleting {{(pid=94460) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4372}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-af56dfb0-b61c-4978-a72c-d032273f84de" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-af56dfb0-b61c-4978-a72c-d032273f84de" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-3a6bac10-7690-4fe2-b723-f26239fabf91" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-3a6bac10-7690-4fe2-b723-f26239fabf91" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Deleting offline snapshot 3a6bac10-7690-4fe2-b723-f26239fabf91 of volume af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] snapshot_file for this snap is: volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09c5015-f828-499f-8c9f-4d57f81e6102]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:54:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:00 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b 1G" returned: 0 in 0.676s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:00 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 Aug 25 06:55:00 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:00 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b Aug 25 06:55:00 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:00 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b" returned: 0 in 0.394s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:00 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b is being set with open permissions: ugo+rw Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:00 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b Aug 25 06:55:00 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:00 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91" returned: 0 in 0.701s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af56dfb0-b61c-4978-a72c-d032273f84de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17a1808-51d3-45c4-9693-9245409e8a31]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:00 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de Aug 25 06:55:00 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:00 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b" returned: 0 in 0.331s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-10f8acc6-9e4e-46ea-ae95-f31178e2da22 tempest-SnapshotsActionsTest-2010783552 None] Create snapshot completed successfully Aug 25 06:55:01 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de" returned: 0 in 0.568s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:01 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 Aug 25 06:55:01 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-9be355be-39be-4177-a132-6512c639077b-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-9be355be-39be-4177-a132-6512c639077b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-9be355be-39be-4177-a132-6512c639077b" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-9be355be-39be-4177-a132-6512c639077b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Deleting offline snapshot 9be355be-39be-4177-a132-6512c639077b of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] snapshot_file for this snap is: volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c3bc64-f18b-437f-b161-de5980d4ae5f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:01 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b Aug 25 06:55:01 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:01 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91" returned: 0 in 0.529s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:01 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91 Aug 25 06:55:01 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:01 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b" returned: 0 in 0.493s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370b162-8d49-432f-ac73-f86e37376c3c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:02 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de.3a6bac10-7690-4fe2-b723-f26239fabf91" returned: 0 in 0.381s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-3a6bac10-7690-4fe2-b723-f26239fabf91" released by "_delete_snapshot" :: held 2.300s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-af56dfb0-b61c-4978-a72c-d032273f84de" released by "delete_snapshot" :: held 2.343s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:02 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:55:02 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:02 devstack cinder-volume[94460]: WARNING cinder.quota [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-791186659 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-791186659, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:02 devstack cinder-volume[94460]: WARNING cinder.quota [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-791186659 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-791186659, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['b59bd147-ecce-4e59-a55f-9d488cfa78f3', '13336d8a-3d7f-45e9-b6e2-c7daf4ffb608', '04de6723-f1a2-41ae-9bbc-ce822573d7a3', 'bbc72c4d-92e2-427f-a12b-64d4a2e1bfa8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-96e74978-5449-4be2-ba04-dc0b6f0e019d tempest-GroupSnapshotsTest-1521311395 None] group_snapshot 200de236-a252-47ed-9d0e-c5222539c826: deleted successfully Aug 25 06:55:02 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.622s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:02 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b Aug 25 06:55:02 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:03 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b" returned: 0 in 0.437s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:03 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b Aug 25 06:55:03 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:03 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.9be355be-39be-4177-a132-6512c639077b" returned: 0 in 0.279s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-9be355be-39be-4177-a132-6512c639077b" released by "_delete_snapshot" :: held 1.981s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" released by "delete_snapshot" :: held 2.029s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Created reservations ['e1552e62-e2ce-4ebb-a8de-152a95908c97', '08728f71-9d58-4fc0-a371-0022bc9bc690', 'bb1db941-15de-4b5a-a079-31503a9f97c6', '5086650d-14b2-488f-a74d-6c97360e17f6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Delete snapshot completed successfully. Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5a9a68a9-913c-485e-9549-50ebb40d7b96 tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-9be355be-39be-4177-a132-6512c639077b-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "cinder-quobyte-af56dfb0-b61c-4978-a72c-d032273f84de" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-af56dfb0-b61c-4978-a72c-d032273f84de" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[73790721-bdbd-4b59-a91d-aa0cd350e442]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:04 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de Aug 25 06:55:04 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:04 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de" returned: 0 in 0.589s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:04 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de Aug 25 06:55:04 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:04 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-af56dfb0-b61c-4978-a72c-d032273f84de" returned: 0 in 0.294s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Lock "cinder-quobyte-af56dfb0-b61c-4978-a72c-d032273f84de" released by "delete_volume" :: held 0.991s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['084052e5-b49b-4fc4-92af-23e2e92f3a30'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:04 devstack cinder-volume[94460]: WARNING cinder.quota [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-791186659 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-791186659, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Creating offline snapshot c2a45228-d1a1-464b-877b-52d5a058a75d of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fcaa34-ce27-4c2c-b2b0-7ae394e1e08b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Created reservations ['400c6496-5252-48ea-8792-d1a6db258214', '49b25398-83c5-4a42-b4a2-08a367334bdc', 'd02b21e1-84f8-4b5a-9ef4-254941f6d4b4', 'd984bfa8-3cf1-4219-bd59-e131f4a49c9f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:05 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:55:05 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:05 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:05 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:05 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:05 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.540s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:05 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9c7bf5df-69db-454f-9544-4c21fd08c396 tempest-GroupSnapshotsTest-1521311395 None] Delete group completed successfully. Aug 25 06:55:05 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d 1G Aug 25 06:55:05 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:06 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d 1G" returned: 0 in 0.454s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:06 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d Aug 25 06:55:06 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:06 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:06 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d is being set with open permissions: ugo+rw Aug 25 06:55:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:06 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d Aug 25 06:55:06 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:06 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d" returned: 0 in 0.296s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.771s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2f24c802-574b-4f99-bdcb-dda6f5ef1201 tempest-SnapshotsActionsTest-2010783552 None] Create snapshot completed successfully Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-c2a45228-d1a1-464b-877b-52d5a058a75d-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-c2a45228-d1a1-464b-877b-52d5a058a75d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Acquiring lock "cinder-quobyte-c2a45228-d1a1-464b-877b-52d5a058a75d" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-c2a45228-d1a1-464b-877b-52d5a058a75d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Deleting offline snapshot c2a45228-d1a1-464b-877b-52d5a058a75d of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] snapshot_file for this snap is: volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c0e6d-f1b3-4dc0-94be-7969efce7bd4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:07 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d Aug 25 06:55:07 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:07 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d" returned: 0 in 0.461s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30efcf8-b3b6-4092-ae45-6ffd845fc907]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:08 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:55:08 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:08 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.425s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:08 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d Aug 25 06:55:08 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:08 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d" returned: 0 in 0.515s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:08 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d Aug 25 06:55:08 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:09 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.c2a45228-d1a1-464b-877b-52d5a058a75d" returned: 0 in 0.299s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-c2a45228-d1a1-464b-877b-52d5a058a75d" released by "_delete_snapshot" :: held 1.852s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" released by "delete_snapshot" :: held 1.887s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:09 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Created reservations ['e03b98de-93e9-47b1-8d31-a85be5bb2d59', '4d023eb9-0d87-4e76-8a78-949adfd1940a', '8fbf318c-e17d-4235-b296-9649d9ce8de2', '7e23fbdd-25c0-48b7-85ef-a9988d5d9216'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Delete snapshot completed successfully. Aug 25 06:55:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-56ad59e1-8ce9-405a-a31c-0a760bb6497a tempest-SnapshotsActionsTest-311816385 None] Lock "cinder-c2a45228-d1a1-464b-877b-52d5a058a75d-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "cinder-1ed4dfdf-3598-49b7-8437-d5298b314af3-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-1ed4dfdf-3598-49b7-8437-d5298b314af3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "cinder-quobyte-1ed4dfdf-3598-49b7-8437-d5298b314af3" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-quobyte-1ed4dfdf-3598-49b7-8437-d5298b314af3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Deleting offline snapshot 1ed4dfdf-3598-49b7-8437-d5298b314af3 of volume 532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] snapshot_file for this snap is: volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[49303732-7dd9-416d-981f-898bc1e09ec7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:10 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:55:10 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:10 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532e1534-bff5-4cf0-8fc0-da1d4524458b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0e0e2-d515-4eba-b144-8840a0ce3dc3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:10 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b Aug 25 06:55:10 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Flow 'volume_create_manager' (d524b3f7-f212-48f1-93e5-01409968880b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae338df-7765-4f4e-988a-7ca1a3acc1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae338df-7765-4f4e-988a-7ca1a3acc1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1048648157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656ee9a7-ffa1-41fa-a3d9-b573b3708bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efcaabfc04343078111ada676808ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:11Z,use_quota=True,user_id='32c1dfce59f3481fb227a2834f7082c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed6c7f9-0f1c-4df3-bd0d-8c12e326f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed6c7f9-0f1c-4df3-bd0d-8c12e326f906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6258e44e-31c2-4400-a647-28bb51d1518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6258e44e-31c2-4400-a647-28bb51d1518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656ee9a7-ffa1-41fa-a3d9-b573b3708bec', 'volume_name': 'volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b7debf-3e2f-405f-b357-36f7b7c237da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b7debf-3e2f-405f-b357-36f7b7c237da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad21e4c-d903-4e1c-90f8-ea0c11464a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Volume 656ee9a7-ffa1-41fa-a3d9-b573b3708bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec', 'volume_size': 1} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1048648157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656ee9a7-ffa1-41fa-a3d9-b573b3708bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efcaabfc04343078111ada676808ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:11Z,use_quota=True,user_id='32c1dfce59f3481fb227a2834f7082c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Creating volume 656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:11 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:11 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:11 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec 1073741824 Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b" returned: 0 in 0.634s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:11 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:11 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:55:11 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:11 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.485s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:11 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3 Aug 25 06:55:11 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:11 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec 1073741824" returned: 0 in 0.689s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:12 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b.1ed4dfdf-3598-49b7-8437-d5298b314af3" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-quobyte-1ed4dfdf-3598-49b7-8437-d5298b314af3" released by "_delete_snapshot" :: held 2.035s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" released by "delete_snapshot" :: held 2.064s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Created reservations ['53c11dc1-ec85-4c3c-ae6d-61615aef9679', 'af6110a4-671c-4900-9047-fdd51d4020f5', '16b64f1a-7b34-4eb0-8ebe-894facfbe465', '47fbf38e-a627-4bd2-a5d7-8dd771d7641b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:12 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:55:12 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Delete snapshot completed successfully. Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-af8c08dc-73a2-42b3-95c2-f377ce3f399f tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-1ed4dfdf-3598-49b7-8437-d5298b314af3-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:12 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.325s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad21e4c-d903-4e1c-90f8-ea0c11464a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d970a5e1-1717-44bb-a6cf-a3197ed49178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:12 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Volume volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec (656ee9a7-ffa1-41fa-a3d9-b573b3708bec): created successfully Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d970a5e1-1717-44bb-a6cf-a3197ed49178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Flow 'volume_create_manager' (d524b3f7-f212-48f1-93e5-01409968880b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a1dbac35-52d3-4f5c-a703-2d4dfbe50360 tempest-VolumesActionsTest-1969636374 None] Created volume successfully. Aug 25 06:55:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "cinder-532e1534-bff5-4cf0-8fc0-da1d4524458b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-532e1534-bff5-4cf0-8fc0-da1d4524458b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:13 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb9388-8c84-4e59-9450-cd89cf43fe0f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:13 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b Aug 25 06:55:13 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:14 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b" returned: 0 in 0.621s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:14 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b Aug 25 06:55:14 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:14 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-532e1534-bff5-4cf0-8fc0-da1d4524458b" returned: 0 in 0.410s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-quobyte-532e1534-bff5-4cf0-8fc0-da1d4524458b" released by "delete_volume" :: held 1.127s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Created reservations ['15566fba-f0df-4268-9d8b-5382cffe8869', 'dab22344-584f-43aa-8dcc-7bb1906a616f', '3ba4084a-0e11-4d1a-a4ab-576db9a4e904', 'e3a0b614-079b-4fc0-b159-e6829ea33a12'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:14 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:14 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:15 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Deleted volume successfully. Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e9ad683-5165-48eb-a130-3e549748e38c tempest-SnapshotsActionsTest-2010783552 None] Lock "cinder-532e1534-bff5-4cf0-8fc0-da1d4524458b-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-4a91ab28-18fe-44d5-9c0e-57ba4d273457 tempest-ServerActionsTestOtherA-186498983 None] Terminate volume connection completed successfully. Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-4a91ab28-18fe-44d5-9c0e-57ba4d273457 tempest-ServerActionsTestOtherA-186498983 None] Deleting attachment 576a13ea-0673-460e-925d-85234f16658d. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "cinder-e8e0f790-3b18-44f8-8848-d0700114969e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-e8e0f790-3b18-44f8-8848-d0700114969e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "cinder-quobyte-e8e0f790-3b18-44f8-8848-d0700114969e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-quobyte-e8e0f790-3b18-44f8-8848-d0700114969e" acquired by "delete_volume" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[01827fd0-d24f-488a-8330-a6e4653b6585]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c5a79f25-d7f3-47e8-ad72-fb50456c8105 tempest-GroupsV314Test-1253218608 None] Group tempest-GroupsV314Test-Group-1935450356: creating Aug 25 06:55:16 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e Aug 25 06:55:16 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c5a79f25-d7f3-47e8-ad72-fb50456c8105 tempest-GroupsV314Test-1253218608 None] Group tempest-GroupsV314Test-Group-1935450356: created successfully Aug 25 06:55:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c5a79f25-d7f3-47e8-ad72-fb50456c8105 tempest-GroupsV314Test-1253218608 None] Create group completed successfully. Aug 25 06:55:16 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e" returned: 0 in 0.646s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:16 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e Aug 25 06:55:16 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "cinder-4d1fdb91-685e-429d-abad-0b009e3a1441-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-4d1fdb91-685e-429d-abad-0b009e3a1441-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "cinder-quobyte-4d1fdb91-685e-429d-abad-0b009e3a1441" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-quobyte-4d1fdb91-685e-429d-abad-0b009e3a1441" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[68002e4a-c22d-4bdf-b655-e711caefc938]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:16 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e8e0f790-3b18-44f8-8848-d0700114969e" returned: 0 in 0.356s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-quobyte-e8e0f790-3b18-44f8-8848-d0700114969e" released by "delete_volume" :: held 1.063s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:16 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 Aug 25 06:55:16 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:16 devstack cinder-volume[94460]: DEBUG cinder.quota [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Created reservations ['4a29de8c-848d-4c99-bbca-ce64ad75d7ab', '31c3cd98-05d5-45b7-a353-6e96f036031e', 'd9016383-26f1-4404-8da7-959db4cf33f5', '0cbcb7ce-984f-490b-8284-aacaf6b4b38c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:17 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:17 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:17 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441" returned: 0 in 0.495s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:17 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441 Aug 25 06:55:17 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:17 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.manager [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Deleted volume successfully. Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-e5d36214-78aa-4e5d-90c8-bda2ea79fb69 req-80bee51b-cb2d-455a-be54-efd20a17d58a tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-e8e0f790-3b18-44f8-8848-d0700114969e-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:17 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4d1fdb91-685e-429d-abad-0b009e3a1441" returned: 0 in 0.416s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-quobyte-4d1fdb91-685e-429d-abad-0b009e3a1441" released by "delete_volume" :: held 0.966s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Created reservations ['11aea4f8-a04c-4245-b696-fa1c25b87e38', '89863add-dadb-4400-8f01-2ae97b1f4289', '32392c3a-c7fc-4273-acf5-cc4356cc7ef7', '2b56759d-9522-4428-b6e5-7c260845d54d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:17 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:17 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Flow 'volume_create_manager' (1a7ba9aa-ce57-493b-bf55-60004c4782ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665e0aa9-0881-4a19-b681-6cb1eb63178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665e0aa9-0881-4a19-b681-6cb1eb63178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124007408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4b839f5-7d0e-45ed-ba13-95301283dfe2,host='devstack@QuobyteHD#QuobyteHD',id=abac826f-f196-41aa-aec2-8c2f284da0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde3111d32094adcbec403053e65cc8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:18Z,use_quota=True,user_id='89586d433f74446f9b10c3c5e454723e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fae9c69-728a-46bf-8d0a-e4cfa7648fc2),volume_type_id=7fae9c69-728a-46bf-8d0a-e4cfa7648fc2)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68723a60-7167-4856-84e3-6c15a0fc86cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68723a60-7167-4856-84e3-6c15a0fc86cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094cb087-0a70-4203-84a6-12f706cccf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094cb087-0a70-4203-84a6-12f706cccf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abac826f-f196-41aa-aec2-8c2f284da0f7', 'volume_name': 'volume-abac826f-f196-41aa-aec2-8c2f284da0f7', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f2fe51-3b3d-49e0-a18c-cce780fea735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f2fe51-3b3d-49e0-a18c-cce780fea735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ac1f21-4475-4f3e-a81a-9d0e9118cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Volume abac826f-f196-41aa-aec2-8c2f284da0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abac826f-f196-41aa-aec2-8c2f284da0f7', 'volume_size': 1} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4b839f5-7d0e-45ed-ba13-95301283dfe2,created_at=2026-08-25T04:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124007408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4b839f5-7d0e-45ed-ba13-95301283dfe2,host='devstack@QuobyteHD#QuobyteHD',id=abac826f-f196-41aa-aec2-8c2f284da0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde3111d32094adcbec403053e65cc8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:18Z,use_quota=True,user_id='89586d433f74446f9b10c3c5e454723e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fae9c69-728a-46bf-8d0a-e4cfa7648fc2),volume_type_id=7fae9c69-728a-46bf-8d0a-e4cfa7648fc2)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Creating volume abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:18 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:18 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 1073741824 Aug 25 06:55:18 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:18 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Deleted volume successfully. Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f1df2c9a-9dc1-499e-83c9-f4905b1d4961 tempest-ServerActionsTestOtherA-186498983 None] Lock "cinder-4d1fdb91-685e-429d-abad-0b009e3a1441-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:18 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 1073741824" returned: 0 in 0.598s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:18 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 Aug 25 06:55:18 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:19 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7" returned: 0 in 0.430s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ac1f21-4475-4f3e-a81a-9d0e9118cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abac826f-f196-41aa-aec2-8c2f284da0f7', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435ff1d6-c3ce-4700-bfce-c1595d698748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Volume volume-abac826f-f196-41aa-aec2-8c2f284da0f7 (abac826f-f196-41aa-aec2-8c2f284da0f7): created successfully Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435ff1d6-c3ce-4700-bfce-c1595d698748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Flow 'volume_create_manager' (1a7ba9aa-ce57-493b-bf55-60004c4782ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8a34f484-8a01-4dc5-9057-7c54f53d9179 tempest-GroupsV314Test-1253218608 None] Created volume successfully. Aug 25 06:55:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:21 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Cloning volume abac826f-f196-41aa-aec2-8c2f284da0f7 to volume 02c304bf-de2b-4639-895f-233769adb2f1 Aug 25 06:55:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Creating offline snapshot 9015c82c-1009-453e-aa2d-2ab83737d9df of volume abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:55:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[541e9727-055b-4201-9307-bb9dc6dc9a3a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:21 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 Aug 25 06:55:21 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:22 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7" returned: 0 in 0.507s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:22 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df 1G Aug 25 06:55:22 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:22 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df 1G" returned: 0 in 0.589s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abac826f-f196-41aa-aec2-8c2f284da0f7 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:22 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abac826f-f196-41aa-aec2-8c2f284da0f7 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df Aug 25 06:55:22 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:23 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abac826f-f196-41aa-aec2-8c2f284da0f7 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df" returned: 0 in 0.527s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:23 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:55:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:23 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df Aug 25 06:55:23 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:23 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df" returned: 0 in 0.508s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:24 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info Aug 25 06:55:24 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:24 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info" returned: 0 in 0.577s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:24 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:55:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:24 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info Aug 25 06:55:24 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:24 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.info" returned: 0 in 0.385s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Acquiring lock "cinder-quobyte-02c304bf-de2b-4639-895f-233769adb2f1" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-02c304bf-de2b-4639-895f-233769adb2f1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] snapshot: 9015c82c-1009-453e-aa2d-2ab83737d9df, volume: 02c304bf-de2b-4639-895f-233769adb2f1, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd7cbd2-5dec-42ec-8e23-6d19dc9c2eba]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:25 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df Aug 25 06:55:25 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:25 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df" returned: 0 in 0.476s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abac826f-f196-41aa-aec2-8c2f284da0f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55858c-d158-4550-a3eb-de9b80bbea1a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:25 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 Aug 25 06:55:25 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:26 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Flow 'volume_create_manager' (e5311b72-29e6-48d0-b18d-bb3d03f6f1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbedf4d3-c32b-4a6c-be01-e8b86bf4be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7" returned: 0 in 0.666s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbedf4d3-c32b-4a6c-be01-e8b86bf4be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-745994414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4f132a-df2c-4afe-9667-6a255b0b895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b3cec3b9f4019b9bc5f96295c9d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:26Z,use_quota=True,user_id='99b94c885ea14321bdb320dfd3b795df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e8600e-c612-4aaf-b7a3-149daf6e6b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e8600e-c612-4aaf-b7a3-149daf6e6b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3a091d-a847-49d5-826a-a475cbf59c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:26 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 Aug 25 06:55:26 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3a091d-a847-49d5-826a-a475cbf59c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4f132a-df2c-4afe-9667-6a255b0b895d', 'volume_name': 'volume-9e4f132a-df2c-4afe-9667-6a255b0b895d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce3efc6-3357-4b76-bc8c-2802e2e80ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce3efc6-3357-4b76-bc8c-2802e2e80ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a729685f-31be-4e52-adf2-4043029a273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:26 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Volume 9e4f132a-df2c-4afe-9667-6a255b0b895d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4f132a-df2c-4afe-9667-6a255b0b895d', 'volume_size': 1} Aug 25 06:55:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea415cd6-d4c0-474e-a658-ff743805974f tempest-VolumesActionsTest-1969636374 None] Acquiring lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" by "attach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea415cd6-d4c0-474e-a658-ff743805974f tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" acquired by "attach_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ea415cd6-d4c0-474e-a658-ff743805974f tempest-VolumesActionsTest-1969636374 None] Attaching volume 656ee9a7-ffa1-41fa-a3d9-b573b3708bec to instance ae8931fd-bdfb-4f53-bfe1-9246aa374b95 at mountpoint /dev/vdb on host None. Aug 25 06:55:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ea415cd6-d4c0-474e-a658-ff743805974f tempest-VolumesActionsTest-1969636374 None] Attach volume completed successfully. Aug 25 06:55:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea415cd6-d4c0-474e-a658-ff743805974f tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" released by "attach_volume" :: held 0.181s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9da510af-71bd-436d-862b-fc0f2da94284 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-detach_volume" by "detach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9da510af-71bd-436d-862b-fc0f2da94284 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9da510af-71bd-436d-862b-fc0f2da94284 tempest-VolumesActionsTest-1969636374 None] Detaching volume 656ee9a7-ffa1-41fa-a3d9-b573b3708bec from instance ae8931fd-bdfb-4f53-bfe1-9246aa374b95. Aug 25 06:55:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9da510af-71bd-436d-862b-fc0f2da94284 tempest-VolumesActionsTest-1969636374 None] Detach volume completed successfully. Aug 25 06:55:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9da510af-71bd-436d-862b-fc0f2da94284 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-detach_volume" released by "detach_volume" :: held 0.260s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:31 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:31 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:32 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.524s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:55:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:55:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:55:33 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1" returned: 0 in 6.789s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:55:33 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Converted 1024.00 MB image at 150.80 MB/s Aug 25 06:55:33 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 is being set with open permissions: ugo+rw: NotImplementedError Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:33 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 Aug 25 06:55:33 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:33 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-02c304bf-de2b-4639-895f-233769adb2f1" released by "_copy_volume_from_snapshot" :: held 8.330s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Acquiring lock "cinder-quobyte-9015c82c-1009-453e-aa2d-2ab83737d9df" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-9015c82c-1009-453e-aa2d-2ab83737d9df" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Deleting offline snapshot 9015c82c-1009-453e-aa2d-2ab83737d9df of volume abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] snapshot_file for this snap is: volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b0115e-e7ab-4ddc-8f2a-7ec181034009]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:33 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df Aug 25 06:55:33 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:33 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df" returned: 0 in 0.490s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abac826f-f196-41aa-aec2-8c2f284da0f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59bbfa2-d3ee-445e-a3b5-fe12c351cec2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:34 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 Aug 25 06:55:34 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:34 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7" returned: 0 in 0.529s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:34 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df Aug 25 06:55:34 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:34 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:34 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df Aug 25 06:55:34 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:35 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7.9015c82c-1009-453e-aa2d-2ab83737d9df" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-9015c82c-1009-453e-aa2d-2ab83737d9df" released by "_delete_snapshot" :: held 1.875s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.621s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.933s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-745994414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4f132a-df2c-4afe-9667-6a255b0b895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b3cec3b9f4019b9bc5f96295c9d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:26Z,use_quota=True,user_id='99b94c885ea14321bdb320dfd3b795df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Creating volume 9e4f132a-df2c-4afe-9667-6a255b0b895d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:35 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:35 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d 1073741824 Aug 25 06:55:35 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0de19324-335d-439e-8abf-8dfe2e0223be tempest-GroupsV314Test-1253218608 None] Create group from source-group-e4b839f5-7d0e-45ed-ba13-95301283dfe2 completed successfully. Aug 25 06:55:35 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d 1073741824" returned: 0 in 0.567s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:35 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d Aug 25 06:55:35 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:36 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=143,cinder:UPDATE=160,cinder:INSERT=39,cinder:DELETE=8 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a729685f-31be-4e52-adf2-4043029a273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4f132a-df2c-4afe-9667-6a255b0b895d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb9431e-ace6-46f5-bc9f-2fbec60fc663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=155,cinder:INSERT=40,cinder:UPDATE=148,cinder:DELETE=7 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:55:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Volume volume-9e4f132a-df2c-4afe-9667-6a255b0b895d (9e4f132a-df2c-4afe-9667-6a255b0b895d): created successfully Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb9431e-ace6-46f5-bc9f-2fbec60fc663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Flow 'volume_create_manager' (e5311b72-29e6-48d0-b18d-bb3d03f6f1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7bf86fd3-59c1-41f2-a6d6-73ea09c0df59 tempest-VolumeQuotasAdminTestJSON-650153996 None] Created volume successfully. Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Acquiring lock "cinder-quobyte-02c304bf-de2b-4639-895f-233769adb2f1" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-02c304bf-de2b-4639-895f-233769adb2f1" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[df274247-da8e-47db-9601-10ae72716d24]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:37 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 Aug 25 06:55:37 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "cinder-9e4f132a-df2c-4afe-9667-6a255b0b895d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "cinder-9e4f132a-df2c-4afe-9667-6a255b0b895d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "cinder-quobyte-9e4f132a-df2c-4afe-9667-6a255b0b895d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:37 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "cinder-quobyte-9e4f132a-df2c-4afe-9667-6a255b0b895d" acquired by "delete_volume" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1" returned: 0 in 0.659s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20a0c62-d8c6-4512-90fe-407f3b1aabce]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:37 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1 Aug 25 06:55:37 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:37 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d Aug 25 06:55:37 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:37 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-02c304bf-de2b-4639-895f-233769adb2f1" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-02c304bf-de2b-4639-895f-233769adb2f1" released by "delete_volume" :: held 1.031s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Created reservations ['ba0a92ad-170c-424b-ab1f-9e87feabb21b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:38 devstack cinder-volume[94460]: WARNING cinder.quota [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1636298062 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1636298062, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:38 devstack cinder-volume[94460]: WARNING cinder.quota [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1636298062 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1636298062, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Created reservations ['578a1621-b4f9-4639-8210-cb3c0defabf6', '75db83ec-29d5-43f1-babb-b95f850649bf', '5db1301c-e3c2-489f-900f-82e481f94c00', 'f1813b76-906c-43f6-851f-f27fef387b41'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:38 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d" returned: 0 in 0.550s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:38 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d Aug 25 06:55:38 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:38 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:38 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:38 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e4f132a-df2c-4afe-9667-6a255b0b895d" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "cinder-quobyte-9e4f132a-df2c-4afe-9667-6a255b0b895d" released by "delete_volume" :: held 0.981s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:38 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.323s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:38 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8e884827-2348-4ae2-9ff7-bd5f025a2c10 tempest-GroupsV314Test-1253218608 None] Delete group completed successfully. Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Created reservations ['809c40a7-93ec-402f-a347-25c003849185', '078630b5-8031-4424-ae57-63307cdcfcbb', '6561c3a4-d2fa-473d-a3ea-2a9227825fd8', '718552c5-a407-4415-9306-9c9f5cafabda'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:38 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:38 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:39 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.283s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Deleted volume successfully. Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-696888ad-8f73-4c22-b5f2-02b44f863eb6 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "cinder-9e4f132a-df2c-4afe-9667-6a255b0b895d-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Acquiring lock "cinder-quobyte-abac826f-f196-41aa-aec2-8c2f284da0f7" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-abac826f-f196-41aa-aec2-8c2f284da0f7" acquired by "delete_volume" :: waited 0.045s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1b394f-7c97-42c9-8cad-6976e62d7d98]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:40 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 Aug 25 06:55:40 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:40 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7" returned: 0 in 0.864s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:40 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7 Aug 25 06:55:40 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:40 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Flow 'volume_create_manager' (ddb8ba64-501f-4315-a37d-417f8963ca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d97ff5-b77e-4fb0-8658-d4f9f8dad2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d97ff5-b77e-4fb0-8658-d4f9f8dad2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1771853585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec477b7b-b224-4840-84e8-7bd2da4139fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b3cec3b9f4019b9bc5f96295c9d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:41Z,use_quota=True,user_id='99b94c885ea14321bdb320dfd3b795df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6475207c-5448-4116-bd15-c76226915f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6475207c-5448-4116-bd15-c76226915f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d09c11c-cacd-4321-b09b-ccab13a858c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d09c11c-cacd-4321-b09b-ccab13a858c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec477b7b-b224-4840-84e8-7bd2da4139fd', 'volume_name': 'volume-ec477b7b-b224-4840-84e8-7bd2da4139fd', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f69905-bd9f-4692-8c7b-8c2880bdea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f69905-bd9f-4692-8c7b-8c2880bdea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27874a1a-d0c0-4f7b-a6be-665585b026d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Volume ec477b7b-b224-4840-84e8-7bd2da4139fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec477b7b-b224-4840-84e8-7bd2da4139fd', 'volume_size': 1} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1771853585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec477b7b-b224-4840-84e8-7bd2da4139fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b3cec3b9f4019b9bc5f96295c9d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:55:41Z,use_quota=True,user_id='99b94c885ea14321bdb320dfd3b795df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Creating volume ec477b7b-b224-4840-84e8-7bd2da4139fd {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:55:41 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:41 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd 1073741824 Aug 25 06:55:41 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:41 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-abac826f-f196-41aa-aec2-8c2f284da0f7" returned: 0 in 0.521s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Lock "cinder-quobyte-abac826f-f196-41aa-aec2-8c2f284da0f7" released by "delete_volume" :: held 1.516s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Created reservations ['39a4e522-dbec-4594-863a-2e3a3eb0bb3f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Created reservations ['15b0ddcc-4319-440f-a1f0-2b8d2cb1b66b', '59a3fd38-8d33-4616-9c85-b0104bdcb939', '7a7a9f94-e293-4be3-865e-060fb2b13767', '25f75a9d-03c9-4a69-b7ce-c469cfef3f42'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:41 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:41 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:41 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd 1073741824" returned: 0 in 0.627s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:41 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd Aug 25 06:55:41 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:42 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27874a1a-d0c0-4f7b-a6be-665585b026d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec477b7b-b224-4840-84e8-7bd2da4139fd', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282dfd19-eea9-4c43-9357-b450bcb12fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:55:42 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Volume volume-ec477b7b-b224-4840-84e8-7bd2da4139fd (ec477b7b-b224-4840-84e8-7bd2da4139fd): created successfully Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282dfd19-eea9-4c43-9357-b450bcb12fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Flow 'volume_create_manager' (ddb8ba64-501f-4315-a37d-417f8963ca57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:55:42 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7f362b8b-6544-4236-a889-facdb79dd0a9 tempest-VolumeQuotasAdminTestJSON-650153996 None] Created volume successfully. Aug 25 06:55:42 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.505s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:42 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:42 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3875d7c9-816a-4966-95fb-374b7a82c65e tempest-GroupsV314Test-1253218608 None] Delete group completed successfully. Aug 25 06:55:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4edaa414-5c0b-49c4-a71a-4f623c010617 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" by "attach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4edaa414-5c0b-49c4-a71a-4f623c010617 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" acquired by "attach_volume" :: waited 0.046s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4edaa414-5c0b-49c4-a71a-4f623c010617 tempest-VolumesActionsTest-1969636374 None] Attaching volume 656ee9a7-ffa1-41fa-a3d9-b573b3708bec to instance e01659a8-36a1-4b1c-b63f-4ebacc4aecbb at mountpoint /dev/vdb on host None. Aug 25 06:55:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4edaa414-5c0b-49c4-a71a-4f623c010617 tempest-VolumesActionsTest-1969636374 None] Attach volume completed successfully. Aug 25 06:55:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4edaa414-5c0b-49c4-a71a-4f623c010617 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" released by "attach_volume" :: held 0.127s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dbe0783-091d-4dd5-b927-540ea352aba9 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-detach_volume" by "detach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dbe0783-091d-4dd5-b927-540ea352aba9 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2dbe0783-091d-4dd5-b927-540ea352aba9 tempest-VolumesActionsTest-1969636374 None] Detaching volume 656ee9a7-ffa1-41fa-a3d9-b573b3708bec from instance e01659a8-36a1-4b1c-b63f-4ebacc4aecbb. Aug 25 06:55:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2dbe0783-091d-4dd5-b927-540ea352aba9 tempest-VolumesActionsTest-1969636374 None] Detach volume completed successfully. Aug 25 06:55:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dbe0783-091d-4dd5-b927-540ea352aba9 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:45 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cc6612a0-d770-45a1-abcd-3376fa190b67 tempest-VolumeQuotasAdminTestJSON-1213056338 None] Transfer volume completed successfully. Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Acquiring lock "cinder-ec477b7b-b224-4840-84e8-7bd2da4139fd-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Lock "cinder-ec477b7b-b224-4840-84e8-7bd2da4139fd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Acquiring lock "cinder-quobyte-ec477b7b-b224-4840-84e8-7bd2da4139fd" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Lock "cinder-quobyte-ec477b7b-b224-4840-84e8-7bd2da4139fd" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e17557-b4d7-412e-a3e3-2606dfc463a2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:46 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd Aug 25 06:55:46 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:46 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd" returned: 0 in 0.435s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:46 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd Aug 25 06:55:46 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:46 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec477b7b-b224-4840-84e8-7bd2da4139fd" returned: 0 in 0.316s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Lock "cinder-quobyte-ec477b7b-b224-4840-84e8-7bd2da4139fd" released by "delete_volume" :: held 0.829s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Created reservations ['73737e0d-abd7-4014-8e8c-d2826cd8d4d9', 'ca7b97f4-d264-481d-ae2b-49112f60f4c2', 'ff6c8302-973e-42ef-a393-6ca8cfddae93', '5fe485b5-7dde-4d91-955e-bcc60f878d57'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:47 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:55:47 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:47 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.305s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:55:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Deleted volume successfully. Aug 25 06:55:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-23eb394d-1934-493a-b655-6e802d65c643 tempest-VolumeQuotasAdminTestJSON-676537311 None] Lock "cinder-ec477b7b-b224-4840-84e8-7bd2da4139fd-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:55:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:55:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:55:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae0e248-bd83-489c-a38f-9f539f5b53d4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:56 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:55:56 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:57 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.670s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0242db43-e088-4401-b90c-f73791efe36f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:55:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:57 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:55:57 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:55:57 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=51,cinder:DELETE=4,cinder:SELECT=32,cinder:INSERT=12 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:55:58 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Aug 25 06:55:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.726s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:55:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.c3332c0d-9dc6-463b-8ca1-d24a6cd53f1bc4hrwh71.img {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:55:58 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.c3332c0d-9dc6-463b-8ca1-d24a6cd53f1bc4hrwh71.img Aug 25 06:55:58 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Flow 'volume_create_manager' (1b9f1e54-983f-4443-a00f-8c831cfef473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7e1662-151a-4268-9e50-664815046c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7e1662-151a-4268-9e50-664815046c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-700796321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29dfa4a4-80ca-4b94-9413-c493e0960a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f6d3411b7d44699bc0bd3acd49ee4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:06Z,use_quota=True,user_id='f9668d1bee0e4447bf2a416af8c69baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5751b83-38c5-4fb7-aa30-0695251880c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5751b83-38c5-4fb7-aa30-0695251880c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d850af-28b9-4ea6-b470-eae43ff0a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d850af-28b9-4ea6-b470-eae43ff0a736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29dfa4a4-80ca-4b94-9413-c493e0960a8e', 'volume_name': 'volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df39d512-0630-4524-98c4-bcae716e17c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df39d512-0630-4524-98c4-bcae716e17c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523b4517-fbf8-4725-8219-a1aa3dfd9e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:06 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Volume 29dfa4a4-80ca-4b94-9413-c493e0960a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e', 'volume_size': 1} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:06 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.c3332c0d-9dc6-463b-8ca1-d24a6cd53f1bc4hrwh71.img" returned: 0 in 8.529s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24e421d-fd47-430f-a436-c51f37c37ef4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:06 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:56:06 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:07 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.764s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:07 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.c3332c0d-9dc6-463b-8ca1-d24a6cd53f1bc4hrwh71.img {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:56:07 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Converted 1024.00 MB image at 120.05 MB/s Aug 25 06:56:07 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] c3332c0d-9dc6-463b-8ca1-d24a6cd53f1b was raw, no need to convert to raw {{(pid=94460) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 25 06:56:17 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=43,cinder:UPDATE=37,cinder:INSERT=9 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:17 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=2 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Flow 'volume_create_manager' (d6caf983-eea5-4bc6-8d70-cecfee087ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e175eb-9ea7-48b1-87e7-2b22623a0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e175eb-9ea7-48b1-87e7-2b22623a0042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-572647896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df23056-d224-4221-82a6-088be027b6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ca46c02a0845f08c67f7b5647b75b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:22Z,use_quota=True,user_id='2525e31736634a809c314ea4c64e2181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bfbef6-ed11-41b2-b9d5-fd85f7a1a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bfbef6-ed11-41b2-b9d5-fd85f7a1a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b52f46-4e0a-40f2-8d74-850a6220f78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b52f46-4e0a-40f2-8d74-850a6220f78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df23056-d224-4221-82a6-088be027b6e1', 'volume_name': 'volume-1df23056-d224-4221-82a6-088be027b6e1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c8f341-2be4-49a3-9cb0-28e505048c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c8f341-2be4-49a3-9cb0-28e505048c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c8fd7f-8e13-4e56-9892-1c8f3a14ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Volume 1df23056-d224-4221-82a6-088be027b6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df23056-d224-4221-82a6-088be027b6e1', 'volume_size': 1} Aug 25 06:56:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Flow 'volume_create_manager' (8057ef7e-3bb5-40fd-adbd-47a2594a691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f810ad-a2ef-40e1-8f63-9706371a51ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f810ad-a2ef-40e1-8f63-9706371a51ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1360066397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deee338f-99e0-43f6-a64f-ef1098857a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499d366136e5478091717fda3448a498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:23Z,use_quota=True,user_id='bfde3d78a485440f81af71e0cdfda787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29d3c866-d283-49b4-a6f3-18d020710c9f),volume_type_id=29d3c866-d283-49b4-a6f3-18d020710c9f)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a16a895-1047-42a2-9df9-0014eb94d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a16a895-1047-42a2-9df9-0014eb94d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4e1ae8-7f66-4263-8578-875815ed1147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4e1ae8-7f66-4263-8578-875815ed1147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deee338f-99e0-43f6-a64f-ef1098857a76', 'volume_name': 'volume-deee338f-99e0-43f6-a64f-ef1098857a76', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91776e3-0e19-41e4-85ab-cb8ecd30d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91776e3-0e19-41e4-85ab-cb8ecd30d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925f7f29-8b85-4738-83cc-7431074e437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:23 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Volume deee338f-99e0-43f6-a64f-ef1098857a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deee338f-99e0-43f6-a64f-ef1098857a76', 'volume_size': 1} Aug 25 06:56:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:31 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:56:31 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:32 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.494s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:56:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:56:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:56:33 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:33 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=3 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.474s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Uploaded volume to glance image-id: c3332c0d-9dc6-463b-8ca1-d24a6cd53f1b. {{(pid=94460) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1801}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.470s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-700796321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29dfa4a4-80ca-4b94-9413-c493e0960a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f6d3411b7d44699bc0bd3acd49ee4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:06Z,use_quota=True,user_id='f9668d1bee0e4447bf2a416af8c69baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Creating volume 29dfa4a4-80ca-4b94-9413-c493e0960a8e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:34 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:34 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e 1073741824 Aug 25 06:56:34 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-62c0199e-7288-4379-8753-ad866c744683 tempest-VolumesActionsTest-1969636374 None] Copy volume to image completed successfully. Aug 25 06:56:34 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e 1073741824" returned: 0 in 0.465s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:34 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e Aug 25 06:56:34 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:34 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.986s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-572647896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df23056-d224-4221-82a6-088be027b6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ca46c02a0845f08c67f7b5647b75b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:22Z,use_quota=True,user_id='2525e31736634a809c314ea4c64e2181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Creating volume 1df23056-d224-4221-82a6-088be027b6e1 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:34 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523b4517-fbf8-4725-8219-a1aa3dfd9e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b09fd8-775b-447b-a1bb-c35e218e24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:34 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 1073741824 Aug 25 06:56:34 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Volume volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e (29dfa4a4-80ca-4b94-9413-c493e0960a8e): created successfully Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b09fd8-775b-447b-a1bb-c35e218e24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Flow 'volume_create_manager' (1b9f1e54-983f-4443-a00f-8c831cfef473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-46b2ca7b-a2ac-4371-b2d9-0e93998f3825 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Created volume successfully. Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:35 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 1073741824" returned: 0 in 0.452s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:35 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 Aug 25 06:56:35 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:35 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1" returned: 0 in 0.242s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.191s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1360066397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deee338f-99e0-43f6-a64f-ef1098857a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499d366136e5478091717fda3448a498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:56:23Z,use_quota=True,user_id='bfde3d78a485440f81af71e0cdfda787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29d3c866-d283-49b4-a6f3-18d020710c9f),volume_type_id=29d3c866-d283-49b4-a6f3-18d020710c9f)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Creating volume deee338f-99e0-43f6-a64f-ef1098857a76 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:56:35 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c8fd7f-8e13-4e56-9892-1c8f3a14ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df23056-d224-4221-82a6-088be027b6e1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b0bdf1-9b3d-4ddf-9a49-0e3ffa14dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:35 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 1073741824 Aug 25 06:56:35 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:35 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Volume volume-1df23056-d224-4221-82a6-088be027b6e1 (1df23056-d224-4221-82a6-088be027b6e1): created successfully Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b0bdf1-9b3d-4ddf-9a49-0e3ffa14dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Flow 'volume_create_manager' (d6caf983-eea5-4bc6-8d70-cecfee087ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c3532b11-51a6-42ec-bb4d-c60336e6ff21 tempest-ServerRescueNegativeTestJSON-1763394867 None] Created volume successfully. Aug 25 06:56:36 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 1073741824" returned: 0 in 0.443s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:36 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 Aug 25 06:56:36 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:36 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76" returned: 0 in 0.239s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.197s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925f7f29-8b85-4738-83cc-7431074e437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deee338f-99e0-43f6-a64f-ef1098857a76', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bc7a58-6d91-461a-9ee6-7edb1f80c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb64e3-884c-43b0-94ab-2708590d5299]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Volume volume-deee338f-99e0-43f6-a64f-ef1098857a76 (deee338f-99e0-43f6-a64f-ef1098857a76): created successfully Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bc7a58-6d91-461a-9ee6-7edb1f80c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Flow 'volume_create_manager' (8057ef7e-3bb5-40fd-adbd-47a2594a691c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:56:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-185b99da-f467-4c49-bc88-5a92edd8d94d tempest-VolumeTypesAccessTest-60688276 None] Created volume successfully. Aug 25 06:56:36 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:56:36 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:36 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.396s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b09ac-695f-4651-bde3-15e29bfba57c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:36 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:56:36 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Acquiring lock "cinder-29dfa4a4-80ca-4b94-9413-c493e0960a8e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Acquiring lock "cinder-deee338f-99e0-43f6-a64f-ef1098857a76-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "cinder-29dfa4a4-80ca-4b94-9413-c493e0960a8e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Lock "cinder-deee338f-99e0-43f6-a64f-ef1098857a76-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Acquiring lock "cinder-quobyte-29dfa4a4-80ca-4b94-9413-c493e0960a8e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Acquiring lock "cinder-quobyte-deee338f-99e0-43f6-a64f-ef1098857a76" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "cinder-quobyte-29dfa4a4-80ca-4b94-9413-c493e0960a8e" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Lock "cinder-quobyte-deee338f-99e0-43f6-a64f-ef1098857a76" acquired by "delete_volume" :: waited 0.058s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b1eaad-21df-421c-ab26-ff2048c7765b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfd545a-7e69-4af4-aea2-3b1367b77351]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:37 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.610s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:37 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e Aug 25 06:56:37 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:37 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img Aug 25 06:56:37 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:37 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 Aug 25 06:56:37 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:37 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e" returned: 0 in 0.427s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:37 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e Aug 25 06:56:37 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:37 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76" returned: 0 in 0.548s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:37 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76 Aug 25 06:56:37 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:38 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-29dfa4a4-80ca-4b94-9413-c493e0960a8e" returned: 0 in 0.570s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "cinder-quobyte-29dfa4a4-80ca-4b94-9413-c493e0960a8e" released by "delete_volume" :: held 1.113s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Created reservations ['3fe1e1cd-e524-4372-8603-b0e83b2a4ea2', '3e79d4a1-cf93-4a74-a8c9-22dd4b45a0c6', 'c7b69c8f-dd77-47e9-bff2-68a2e9559a46', '013971b5-11bc-4a7f-a5a3-db7a57ae14ab'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:38 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-deee338f-99e0-43f6-a64f-ef1098857a76" returned: 0 in 1.004s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Lock "cinder-quobyte-deee338f-99e0-43f6-a64f-ef1098857a76" released by "delete_volume" :: held 1.685s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:39 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:56:39 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:39 devstack cinder-volume[94460]: WARNING cinder.quota [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-829940217 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-829940217, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:56:39 devstack cinder-volume[94460]: WARNING cinder.quota [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-829940217 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-829940217, it is now deprecated. Please use the default quota class for default quota. Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Created reservations ['bad9d75b-f507-46ee-9fcf-3002796e90d6', 'd831ec68-bf51-457e-bd20-77e7946a7d97', 'c8cd4ce3-6455-42f7-a262-3410dc82f0e7', '8c3135eb-2d4a-4bdd-b922-6d600ef45f3f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:39 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:56:39 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:39 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.866s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Deleted volume successfully. Aug 25 06:56:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80439139-113d-4865-8807-64cfacfc1a60 tempest-VolumeQuotasNegativeTestJSON-709199899 None] Lock "cinder-29dfa4a4-80ca-4b94-9413-c493e0960a8e-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.850s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:40 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:40 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Deleted volume successfully. Aug 25 06:56:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6d41c288-221f-4b62-b3d8-fc85a8271366 tempest-VolumeTypesAccessTest-60688276 None] Lock "cinder-deee338f-99e0-43f6-a64f-ef1098857a76-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:44 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img" returned: 0 in 6.794s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abce435-f989-4d34-8dea-6af29d547d71]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:44 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:56:44 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:45 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.794s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:56:45 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Converted 1024.00 MB image at 150.70 MB/s Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] 0ad0de7b-3054-40cd-9482-2768b9dba404 was raw, converting to qcow2 {{(pid=94460) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac4cfe0-084e-4d73-b9c8-a4c3bb805116]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:45 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img Aug 25 06:56:45 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:45 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img" returned: 0 in 0.406s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:45 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img Aug 25 06:56:45 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:45 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img" returned: 1 in 0.410s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:56:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:45 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz Aug 25 06:56:45 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:46 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz" returned: 0 in 0.466s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:46 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Image conversion details: src /opt/stack/data/cinder/conversion/656ee9a7-ffa1-41fa-a3d9-b573b3708bec.temp_image.0ad0de7b-3054-40cd-9482-2768b9dba40441rjyslx.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:56:46 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 25 06:56:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[edddeacf-4d96-457d-9674-4e42ebfcd3c2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:46 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz Aug 25 06:56:46 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:46 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pmwc1ivz" returned: 0 in 0.520s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.168s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Uploaded volume to glance image-id: 0ad0de7b-3054-40cd-9482-2768b9dba404. {{(pid=94460) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1801}} Aug 25 06:56:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-679e31b3-03bc-4140-bdcf-6a787c799bdb tempest-VolumesActionsTest-1969636374 None] Copy volume to image completed successfully. Aug 25 06:56:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "cinder-quobyte-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-quobyte-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:51 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab73fd-3c96-4d98-9cca-99b96941acbf]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:51 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:56:51 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Acquiring lock "cinder-1df23056-d224-4221-82a6-088be027b6e1-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "cinder-1df23056-d224-4221-82a6-088be027b6e1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Acquiring lock "cinder-quobyte-1df23056-d224-4221-82a6-088be027b6e1" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "cinder-quobyte-1df23056-d224-4221-82a6-088be027b6e1" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8337034b-6a40-405a-b022-f7d269eaadda]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:52 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.745s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:52 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 Aug 25 06:56:52 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:52 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec Aug 25 06:56:52 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:52 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" returned: 0 in 0.454s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-quobyte-656ee9a7-ffa1-41fa-a3d9-b573b3708bec" released by "delete_volume" :: held 1.298s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Created reservations ['44ccc3a8-21da-4ec1-9b99-a13405c4073d', '34055c57-4a72-485a-b846-aa63676b6703', '9a44b728-74dd-4aa6-b651-1281534401c6', 'b14a1621-c787-40dd-848e-4f017b59a01f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:52 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1" returned: 0 in 0.746s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:53 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1 Aug 25 06:56:53 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:53 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:56:53 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:53 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.351s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:53 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1df23056-d224-4221-82a6-088be027b6e1" returned: 0 in 0.484s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Deleted volume successfully. Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "cinder-quobyte-1df23056-d224-4221-82a6-088be027b6e1" released by "delete_volume" :: held 1.316s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87d628f5-bc36-40e5-a0df-58f65705cb13 tempest-VolumesActionsTest-1969636374 None] Lock "cinder-656ee9a7-ffa1-41fa-a3d9-b573b3708bec-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Created reservations ['26423288-c393-4cfa-bac3-5486e08ca0af', 'f30508d0-1c8f-4dcc-b0ac-d2f0bd091fd9', '776a9d32-fed9-43c6-930a-b1657184432f', '15fde4c9-6673-44d4-9464-918cf77cf82e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:56:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:56:53 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:56:53 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:56:54 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Aug 25 06:56:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.322s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:56:54 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:56:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Deleted volume successfully. Aug 25 06:56:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9023069a-1951-49dd-a070-92190d63ddaa tempest-ServerRescueNegativeTestJSON-1763394867 None] Lock "cinder-1df23056-d224-4221-82a6-088be027b6e1-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Flow 'volume_create_manager' (676bd6ab-4fd5-4932-b564-3e6ca5bcd4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81a5252-a470-40a1-a2b7-45c3a754cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81a5252-a470-40a1-a2b7-45c3a754cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-78058225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc80eb6b-4312-481f-95bc-27fcbdb7dbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b884db37834a4cf0a6a9050c2b648bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:06Z,use_quota=True,user_id='2f1d792e926d4c3cbc81cabb77a68510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb507544-dc39-4825-be34-047f3d9d8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb507544-dc39-4825-be34-047f3d9d8a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960740ea-d47b-4f73-be94-ce6b42f408c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960740ea-d47b-4f73-be94-ce6b42f408c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc80eb6b-4312-481f-95bc-27fcbdb7dbbe', 'volume_name': 'volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe', 'volume_size': 2}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e289b2-050c-4e15-9487-55ea4bf7c558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e289b2-050c-4e15-9487-55ea4bf7c558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a3fc47-40bb-4360-b472-5eb094ae4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:05 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Volume bc80eb6b-4312-481f-95bc-27fcbdb7dbbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe', 'volume_size': 2} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-78058225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc80eb6b-4312-481f-95bc-27fcbdb7dbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b884db37834a4cf0a6a9050c2b648bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:06Z,use_quota=True,user_id='2f1d792e926d4c3cbc81cabb77a68510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Creating volume bc80eb6b-4312-481f-95bc-27fcbdb7dbbe {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:05 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe 2147483648 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:05 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe 2147483648 Aug 25 06:57:05 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Flow 'volume_create_manager' (a9a1a118-0e3b-414e-a008-feaaa606a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab361b8-e942-4af1-95c5-f6b2b23ba27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab361b8-e942-4af1-95c5-f6b2b23ba27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120416674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad60f10-47c7-48b9-b95d-652b399fa11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2590b6f3cd04af9b7eb47f40ec8d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:06Z,use_quota=True,user_id='a5910ce9f63849118c16d3e081fd904e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d38751-9f1c-40f4-8df0-668e5d8dd484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d38751-9f1c-40f4-8df0-668e5d8dd484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37554e6-e64e-4aa0-ac7f-a1b1b5314404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37554e6-e64e-4aa0-ac7f-a1b1b5314404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad60f10-47c7-48b9-b95d-652b399fa11b', 'volume_name': 'volume-1ad60f10-47c7-48b9-b95d-652b399fa11b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959bcc85-9088-4fa6-8892-59ba718ee69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959bcc85-9088-4fa6-8892-59ba718ee69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a18680-0709-489b-9ec3-e277603ff939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:06 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Volume 1ad60f10-47c7-48b9-b95d-652b399fa11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad60f10-47c7-48b9-b95d-652b399fa11b', 'volume_size': 1} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:06 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe 2147483648" returned: 0 in 0.602s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:06 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe Aug 25 06:57:06 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:06 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe" returned: 0 in 0.346s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120416674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad60f10-47c7-48b9-b95d-652b399fa11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2590b6f3cd04af9b7eb47f40ec8d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:06Z,use_quota=True,user_id='a5910ce9f63849118c16d3e081fd904e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Creating volume 1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:06 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:06 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b 1073741824 Aug 25 06:57:06 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a3fc47-40bb-4360-b472-5eb094ae4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe', 'volume_size': 2}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c19534-516f-4663-a602-feb8a0c82637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:06 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Volume volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe (bc80eb6b-4312-481f-95bc-27fcbdb7dbbe): created successfully Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c19534-516f-4663-a602-feb8a0c82637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Flow 'volume_create_manager' (676bd6ab-4fd5-4932-b564-3e6ca5bcd4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c98356af-0186-41f9-9581-043bf8ace245 tempest-VolumesCloneNegativeTest-316160055 None] Created volume successfully. Aug 25 06:57:07 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b 1073741824" returned: 0 in 0.481s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:07 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b Aug 25 06:57:07 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:07 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b" returned: 0 in 0.267s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a18680-0709-489b-9ec3-e277603ff939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad60f10-47c7-48b9-b95d-652b399fa11b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1cb49f-d638-4b2d-8f25-923fb72ab6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:07 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Volume volume-1ad60f10-47c7-48b9-b95d-652b399fa11b (1ad60f10-47c7-48b9-b95d-652b399fa11b): created successfully Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1cb49f-d638-4b2d-8f25-923fb72ab6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Flow 'volume_create_manager' (a9a1a118-0e3b-414e-a008-feaaa606a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:07 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2d3c9213-7a69-496f-b50f-06ce82bb1f1d tempest-VolumesDeleteCascade-1714670895 None] Created volume successfully. Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Acquiring lock "cinder-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Lock "cinder-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Acquiring lock "cinder-quobyte-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Lock "cinder-quobyte-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5256f7-232f-46a2-86c6-6635a6610972]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Creating offline snapshot 71741103-0fe3-404c-958b-bb55bfa3d6a3 of volume 1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0220a0-f369-4d93-99c1-11de00c3409f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:08 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe Aug 25 06:57:08 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:08 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b Aug 25 06:57:08 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:08 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe" returned: 0 in 0.519s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:08 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe Aug 25 06:57:08 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:08 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b" returned: 0 in 0.532s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:08 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 1G Aug 25 06:57:08 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:09 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Lock "cinder-quobyte-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe" released by "delete_volume" :: held 1.030s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Created reservations ['11c00605-052f-4765-b307-d58d5db11903', '1ba2e2b8-04a2-49b4-a593-c04ddd0ccd28', 'a7fd44c7-570d-4174-873d-fbc5c022afd0', '5b5525f5-f03b-43dc-9b3d-ddb1556ce0bf'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:09 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:09 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:09 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 1G" returned: 0 in 0.675s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad60f10-47c7-48b9-b95d-652b399fa11b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:09 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad60f10-47c7-48b9-b95d-652b399fa11b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:09 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:09 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Deleted volume successfully. Aug 25 06:57:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-314cd925-6b76-4248-b5b4-80b3e71fc501 tempest-VolumesCloneNegativeTest-316160055 None] Lock "cinder-bc80eb6b-4312-481f-95bc-27fcbdb7dbbe-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:10 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad60f10-47c7-48b9-b95d-652b399fa11b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.422s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:10 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 is being set with open permissions: ugo+rw Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:10 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:10 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:10 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.286s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:10 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info Aug 25 06:57:10 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:10 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info" returned: 0 in 0.280s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:10 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info is being set with open permissions: ugo+rw Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:10 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info Aug 25 06:57:10 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:10 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.info" returned: 0 in 0.290s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6c465db8-e06d-4edf-bf03-df456ba2e8b2 tempest-VolumesDeleteCascade-1714670895 None] Create snapshot completed successfully Aug 25 06:57:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Creating offline snapshot 25acedd6-7377-4c34-ad56-7d476f20e353 of volume 1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:57:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae725488-46d7-4ec2-825d-befc87a01c87]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:12 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:12 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:12 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.553s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad60f10-47c7-48b9-b95d-652b399fa11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:57:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:12 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 1G Aug 25 06:57:12 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Flow 'volume_create_manager' (a2eecba6-05fd-47d8-bf20-3477c8d45262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb457f7b-1b7c-4eb9-8023-3472e11f4d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb457f7b-1b7c-4eb9-8023-3472e11f4d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2098982329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567c0a5f-8e48-46af-8456-4490a5ccf54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d1df9414c8464aa28b35ea2f6ff010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:13Z,use_quota=True,user_id='f063e0c2ec274644aaabd7b333e16250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c8b5c9-d07f-4e40-9953-264e9252821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:13 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c8b5c9-d07f-4e40-9953-264e9252821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe1c8b9-917f-46e8-8670-e75555765248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 1G" returned: 0 in 0.691s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:13 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 Aug 25 06:57:13 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:13 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353" returned: 0 in 0.362s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:13 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 is being set with open permissions: ugo+rw Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:13 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 Aug 25 06:57:13 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe1c8b9-917f-46e8-8670-e75555765248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '567c0a5f-8e48-46af-8456-4490a5ccf54d', 'volume_name': 'volume-567c0a5f-8e48-46af-8456-4490a5ccf54d', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf118f9-184e-4814-a18e-6b3ada5c1654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf118f9-184e-4814-a18e-6b3ada5c1654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c804d619-ddfd-4bea-865b-374d80ea0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:13 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Volume 567c0a5f-8e48-46af-8456-4490a5ccf54d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-567c0a5f-8e48-46af-8456-4490a5ccf54d', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Trying to clone 567c0a5f-8e48-46af-8456-4490a5ccf54d from image d970149c-5c62-44a8-b2c8-06c24c805604 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:57:13 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353" returned: 0 in 0.430s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:14 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-73a1dedb-b0a1-46a1-9b1a-7099d0c98c19 tempest-VolumesDeleteCascade-1714670895 None] Create snapshot completed successfully Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:57:14 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc63420-938f-460b-ad5b-d0b049df7030]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:14 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD Aug 25 06:57:14 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:14 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 is fetched for user f063e0c2ec274644aaabd7b333e16250. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c973b79-7e4d-40c9-9bf2-09a0d49f154d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:14 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD Aug 25 06:57:14 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-1ad60f10-47c7-48b9-b95d-652b399fa11b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-1ad60f10-47c7-48b9-b95d-652b399fa11b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Performing cascade delete. {{(pid=94460) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-25acedd6-7377-4c34-ad56-7d476f20e353-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-25acedd6-7377-4c34-ad56-7d476f20e353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-25acedd6-7377-4c34-ad56-7d476f20e353" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-25acedd6-7377-4c34-ad56-7d476f20e353" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Deleting offline snapshot 25acedd6-7377-4c34-ad56-7d476f20e353 of volume 1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] snapshot_file for this snap is: volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d37e37-7649-4d04-acf2-1ec98e6f3901]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:15 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2098982329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567c0a5f-8e48-46af-8456-4490a5ccf54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d1df9414c8464aa28b35ea2f6ff010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:13Z,use_quota=True,user_id='f063e0c2ec274644aaabd7b333e16250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Creating volume 567c0a5f-8e48-46af-8456-4490a5ccf54d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:15 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:15 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d 1073741824 Aug 25 06:57:15 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:15 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 Aug 25 06:57:15 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:16 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353" returned: 0 in 0.579s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad60f10-47c7-48b9-b95d-652b399fa11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f3317-90b3-4329-b3a2-3883314ae7d1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:16 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d 1073741824" returned: 0 in 0.595s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:16 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d Aug 25 06:57:16 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:16 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:16 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:16 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d" returned: 0 in 0.341s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Attempting download of d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume 567c0a5f-8e48-46af-8456-4490a5ccf54d. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:57:16 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.542s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad60f10-47c7-48b9-b95d-652b399fa11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[37056a19-3f56-4f93-8851-1855d9f29944]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:16 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 Aug 25 06:57:16 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:16 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr Aug 25 06:57:16 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:17 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr" returned: 0 in 0.412s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:17 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353" returned: 0 in 0.504s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:17 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353 Aug 25 06:57:17 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:17 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr Aug 25 06:57:17 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:17 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr" returned: 1 in 0.392s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_kaph1pcr' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a8e9b-3065-466f-aa1f-2c65decfcff6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:17 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.25acedd6-7377-4c34-ad56-7d476f20e353" returned: 0 in 0.369s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-25acedd6-7377-4c34-ad56-7d476f20e353" released by "_delete_snapshot" :: held 2.125s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" released by "delete_snapshot" :: held 2.165s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:17 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD Aug 25 06:57:17 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Created reservations ['3c32b4da-6de2-48d4-8d1c-aecf4ef8c550', 'b6da3c2d-cdce-41d6-b1ff-840bcdb30f42', '5e1b2e0b-3e2d-4d98-a3bc-75228a5caa27', '7dfdfa85-86cf-4893-b554-ddd9cab43331'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Delete snapshot completed successfully. Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-25acedd6-7377-4c34-ad56-7d476f20e353-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-71741103-0fe3-404c-958b-bb55bfa3d6a3-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-71741103-0fe3-404c-958b-bb55bfa3d6a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-71741103-0fe3-404c-958b-bb55bfa3d6a3" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-71741103-0fe3-404c-958b-bb55bfa3d6a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Deleting offline snapshot 71741103-0fe3-404c-958b-bb55bfa3d6a3 of volume 1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] snapshot_file for this snap is: volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac49900d-4bab-463d-82c8-9044f535dd30]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:17 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] d970149c-5c62-44a8-b2c8-06c24c805604 was qcow2, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:57:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:17 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:17 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:17 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d Aug 25 06:57:17 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:18 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.451s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad60f10-47c7-48b9-b95d-652b399fa11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:57:18 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[589d4365-b4a9-4856-baf0-026110e51a4a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:18 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b Aug 25 06:57:18 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:18 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b" returned: 0 in 0.567s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:18 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:18 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:19 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.463s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:19 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3 Aug 25 06:57:19 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:19 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b.71741103-0fe3-404c-958b-bb55bfa3d6a3" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-71741103-0fe3-404c-958b-bb55bfa3d6a3" released by "_delete_snapshot" :: held 1.962s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" released by "delete_snapshot" :: held 1.992s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Created reservations ['94ef5314-e0aa-41bb-833b-2a73962fbea4', '0b869bc2-2a01-4fe5-9432-07ca437e9070', '9d2b1f88-1066-45a4-b991-480313e7b13f', '3456a6ab-0c43-4754-9495-509476f68725'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Delete snapshot completed successfully. Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-71741103-0fe3-404c-958b-bb55bfa3d6a3-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Snapshots deleted, issuing volume delete {{(pid=94460) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1030}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e7ba7-2c0e-4d72-9b20-1e93bb092fba]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:20 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b Aug 25 06:57:20 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:20 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d" returned: 0 in 2.321s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_epcak30adevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:57:20 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Converted 112.00 MB image at 48.20 MB/s Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:20 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d 1G Aug 25 06:57:20 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:20 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b" returned: 0 in 0.548s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:20 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b Aug 25 06:57:20 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:20 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d 1G" returned: 0 in 0.686s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Downloaded image d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume 567c0a5f-8e48-46af-8456-4490a5ccf54d successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:57:20 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 for user f063e0c2ec274644aaabd7b333e16250 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Marking volume 567c0a5f-8e48-46af-8456-4490a5ccf54d as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:57:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ad60f10-47c7-48b9-b95d-652b399fa11b" returned: 0 in 0.429s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-1ad60f10-47c7-48b9-b95d-652b399fa11b" released by "delete_volume" :: held 1.081s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Copying metadata from image d970149c-5c62-44a8-b2c8-06c24c805604 to 567c0a5f-8e48-46af-8456-4490a5ccf54d. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Creating volume glance metadata for volume 567c0a5f-8e48-46af-8456-4490a5ccf54d backed by image d970149c-5c62-44a8-b2c8-06c24c805604 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Created reservations ['ea14610a-eb32-41cf-be54-31ee2d599a6e', '0939bd8e-9487-4876-9314-f6e3ff386193', 'faec0f7e-31fe-4136-a548-56d2e49dfa3e', '21c9ac94-7a68-4b60-a3ca-a14def94d443'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c804d619-ddfd-4bea-865b-374d80ea0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567c0a5f-8e48-46af-8456-4490a5ccf54d', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9d1ec4-f134-4ebf-908f-3807463ab200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Volume volume-567c0a5f-8e48-46af-8456-4490a5ccf54d (567c0a5f-8e48-46af-8456-4490a5ccf54d): created successfully Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9d1ec4-f134-4ebf-908f-3807463ab200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Flow 'volume_create_manager' (a2eecba6-05fd-47d8-bf20-3477c8d45262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-03e54a12-2540-48d8-ae8f-4cf44a727a13 tempest-VolumesImageMetadata-318423783 None] Created volume successfully. Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:21 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:21 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:21 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Deleted volume successfully. Aug 25 06:57:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaef2db0-f709-4c86-93ff-d70aa0aa733b tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-1ad60f10-47c7-48b9-b95d-652b399fa11b-delete_volume" released by "delete_volume" :: held 6.351s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Acquiring lock "cinder-567c0a5f-8e48-46af-8456-4490a5ccf54d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Lock "cinder-567c0a5f-8e48-46af-8456-4490a5ccf54d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Acquiring lock "cinder-quobyte-567c0a5f-8e48-46af-8456-4490a5ccf54d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Lock "cinder-quobyte-567c0a5f-8e48-46af-8456-4490a5ccf54d" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7834066d-a71c-4140-bb33-9eca14363179]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:22 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d Aug 25 06:57:22 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:22 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Flow 'volume_create_manager' (8da9c04e-68e6-49e8-a930-3a805a94f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c8cd5e-7c95-4b06-887a-f50e41205d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c8cd5e-7c95-4b06-887a-f50e41205d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2082342068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ee2b48-8e66-43df-8c49-6b38803f8ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2590b6f3cd04af9b7eb47f40ec8d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:23Z,use_quota=True,user_id='a5910ce9f63849118c16d3e081fd904e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7557870-7ba4-4275-b770-871fcc3012b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7557870-7ba4-4275-b770-871fcc3012b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6371a4-6fec-4ed2-bf37-05ece9658868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6371a4-6fec-4ed2-bf37-05ece9658868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ee2b48-8e66-43df-8c49-6b38803f8ad3', 'volume_name': 'volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c580f59f-dbda-4c56-baac-0e4a940fae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c580f59f-dbda-4c56-baac-0e4a940fae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8359ffa-8733-4b7d-a891-b5fa47680875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:23 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Volume c9ee2b48-8e66-43df-8c49-6b38803f8ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3', 'volume_size': 1} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2082342068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ee2b48-8e66-43df-8c49-6b38803f8ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2590b6f3cd04af9b7eb47f40ec8d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:23Z,use_quota=True,user_id='a5910ce9f63849118c16d3e081fd904e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Creating volume c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:23 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:23 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d" returned: 0 in 0.547s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:23 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 1073741824 Aug 25 06:57:23 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:23 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d Aug 25 06:57:23 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:23 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-567c0a5f-8e48-46af-8456-4490a5ccf54d" returned: 0 in 0.357s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Lock "cinder-quobyte-567c0a5f-8e48-46af-8456-4490a5ccf54d" released by "delete_volume" :: held 0.994s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Created reservations ['740a0aeb-6c5e-439e-9aca-f51fac1c3354', '242df362-cf81-4e67-9641-26f904dcfa2f', '8d612689-84e4-4e25-ab21-e71614a8d64c', 'ffb3d099-8247-4007-a8d5-cef0ad7fdd53'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:23 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:23 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:23 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 1073741824" returned: 0 in 0.620s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:23 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 Aug 25 06:57:23 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:24 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Deleted volume successfully. Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d136bb6-0a73-4429-b4ce-b0a35d4d9179 tempest-VolumesImageMetadata-318423783 None] Lock "cinder-567c0a5f-8e48-46af-8456-4490a5ccf54d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:24 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" returned: 0 in 0.365s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8359ffa-8733-4b7d-a891-b5fa47680875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819c32c8-5e7a-4f94-9395-115c0011cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:24 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Volume volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 (c9ee2b48-8e66-43df-8c49-6b38803f8ad3): created successfully Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819c32c8-5e7a-4f94-9395-115c0011cc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Flow 'volume_create_manager' (8da9c04e-68e6-49e8-a930-3a805a94f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d7dab94a-130c-45eb-b5ef-6f985bf6ae45 tempest-VolumesDeleteCascade-1714670895 None] Created volume successfully. Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Creating offline snapshot ce9ac493-ee61-4229-8413-305ebd0c0833 of volume c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d9b8f7-b7f5-4683-8d83-4e7ee357883b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:25 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 Aug 25 06:57:25 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:25 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" returned: 0 in 0.421s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:25 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 1G Aug 25 06:57:25 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:26 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 1G" returned: 0 in 0.605s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:26 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 Aug 25 06:57:26 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:26 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833" returned: 0 in 0.419s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:26 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 is being set with open permissions: ugo+rw Aug 25 06:57:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:26 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 Aug 25 06:57:26 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:27 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833" returned: 0 in 0.313s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:27 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info Aug 25 06:57:27 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:27 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info" returned: 0 in 0.358s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:27 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info is being set with open permissions: ugo+rw Aug 25 06:57:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:27 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info Aug 25 06:57:27 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:27 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.info" returned: 0 in 0.291s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9217f8f1-08ba-454a-855b-0cd200298055 tempest-VolumesDeleteCascade-1714670895 None] Create snapshot completed successfully Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Flow 'volume_create_manager' (d2e38743-b1d4-4f22-847a-ab0df58e399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0039c855-454c-4805-8da0-e17b39a5d02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0039c855-454c-4805-8da0-e17b39a5d02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1718691311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eef1402-40e0-4d2c-bfd8-1ed71e25d363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2590b6f3cd04af9b7eb47f40ec8d056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce9ac493-ee61-4229-8413-305ebd0c0833,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:29Z,use_quota=True,user_id='a5910ce9f63849118c16d3e081fd904e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf31d9e-3f0c-4d9c-9992-c5bc756a9e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf31d9e-3f0c-4d9c-9992-c5bc756a9e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832368cb-35f0-4c61-a760-2b152c7b8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832368cb-35f0-4c61-a760-2b152c7b8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8eef1402-40e0-4d2c-bfd8-1ed71e25d363', 'volume_name': 'volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363', 'volume_size': 1, 'snapshot_id': 'ce9ac493-ee61-4229-8413-305ebd0c0833'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449ab819-df01-40d9-9f15-a726dc83d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449ab819-df01-40d9-9f15-a726dc83d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11eb5e87-2f83-4bd1-a49e-43c433a88fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:29 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Volume 8eef1402-40e0-4d2c-bfd8-1ed71e25d363: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363', 'volume_size': 1, 'snapshot_id': 'ce9ac493-ee61-4229-8413-305ebd0c0833'} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-ce9ac493-ee61-4229-8413-305ebd0c0833-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-ce9ac493-ee61-4229-8413-305ebd0c0833-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Creating volume 8eef1402-40e0-4d2c-bfd8-1ed71e25d363 from snapshot ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] snapshot: ce9ac493-ee61-4229-8413-305ebd0c0833, volume: 8eef1402-40e0-4d2c-bfd8-1ed71e25d363, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5263ce48-722e-4ab4-b3a8-9dffaf0d22aa]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:29 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 Aug 25 06:57:29 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:30 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833" returned: 0 in 0.587s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafd0a5-d032-4bbd-8fe7-358435cfea2c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:30 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 Aug 25 06:57:30 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:30 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" returned: 0 in 0.500s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:57:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:30 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 Aug 25 06:57:30 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:31 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:31 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:32 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.704s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:57:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:57:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:57:32 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Flow 'volume_create_manager' (d2ea4d53-4774-4899-836b-f77d9fafde32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb132a0-af7a-4f99-8c98-47867b36634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb132a0-af7a-4f99-8c98-47867b36634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1078072952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc88db4-3841-42fd-a5a2-63e1dfd4e632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351b1022980941099d5040cc59456d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:33Z,use_quota=True,user_id='7f95fc55808040ac906f81b19c261e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92349562-e149-464e-8482-4ab47fd7de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92349562-e149-464e-8482-4ab47fd7de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf1d4fe-3aac-4237-81fb-46ddb18f177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf1d4fe-3aac-4237-81fb-46ddb18f177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc88db4-3841-42fd-a5a2-63e1dfd4e632', 'volume_name': 'volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a105535c-b65e-41ce-bfc9-8c048ac6e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a105535c-b65e-41ce-bfc9-8c048ac6e908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73f2c08-e6cb-4d1f-a512-ef19a6046e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:33 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Volume ccc88db4-3841-42fd-a5a2-63e1dfd4e632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632', 'volume_size': 1} Aug 25 06:57:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:36 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" returned: 0 in 5.738s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:57:36 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Converted 1024.00 MB image at 178.42 MB/s Aug 25 06:57:36 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 is being set with open permissions: ugo+rw Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:36 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 Aug 25 06:57:36 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:36 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" returned: 0 in 0.288s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" released by "_copy_volume_from_snapshot" :: held 7.292s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=82,cinder:UPDATE=103,cinder:DELETE=9,cinder:INSERT=28 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=78,cinder:UPDATE=87,cinder:INSERT=30,cinder:DELETE=8 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-ce9ac493-ee61-4229-8413-305ebd0c0833-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" released by "_create_volume_from_snapshot" :: held 7.395s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.419s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.558s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1078072952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc88db4-3841-42fd-a5a2-63e1dfd4e632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351b1022980941099d5040cc59456d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:33Z,use_quota=True,user_id='7f95fc55808040ac906f81b19c261e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Creating volume ccc88db4-3841-42fd-a5a2-63e1dfd4e632 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:36 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:36 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 1073741824 Aug 25 06:57:36 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11eb5e87-2f83-4bd1-a49e-43c433a88fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363', 'volume_size': 1, 'snapshot_id': 'ce9ac493-ee61-4229-8413-305ebd0c0833'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c8017f-7889-4bb2-a1fb-fd093b847e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Volume volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 (8eef1402-40e0-4d2c-bfd8-1ed71e25d363): created successfully Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c8017f-7889-4bb2-a1fb-fd093b847e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Flow 'volume_create_manager' (d2e38743-b1d4-4f22-847a-ab0df58e399d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-071e6b6b-2491-4c7e-8eae-be84af600904 tempest-VolumesDeleteCascade-1714670895 None] Created volume successfully. Aug 25 06:57:37 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 1073741824" returned: 0 in 0.562s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-c9ee2b48-8e66-43df-8c49-6b38803f8ad3-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-c9ee2b48-8e66-43df-8c49-6b38803f8ad3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:37 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 Aug 25 06:57:37 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Performing cascade delete. {{(pid=94460) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-ce9ac493-ee61-4229-8413-305ebd0c0833-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-ce9ac493-ee61-4229-8413-305ebd0c0833-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-ce9ac493-ee61-4229-8413-305ebd0c0833" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-ce9ac493-ee61-4229-8413-305ebd0c0833" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Deleting offline snapshot ce9ac493-ee61-4229-8413-305ebd0c0833 of volume c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] snapshot_file for this snap is: volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f117d6c9-fa0a-44bf-88fe-1c54c4eb31c7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:37 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632" returned: 0 in 0.418s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:37 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 Aug 25 06:57:37 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73f2c08-e6cb-4d1f-a512-ef19a6046e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a887ed-a5a0-4a7f-a0e4-eaeb6f458265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Volume volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 (ccc88db4-3841-42fd-a5a2-63e1dfd4e632): created successfully Aug 25 06:57:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a887ed-a5a0-4a7f-a0e4-eaeb6f458265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Flow 'volume_create_manager' (d2ea4d53-4774-4899-836b-f77d9fafde32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:38 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-19e1a383-1041-4838-9284-347a38df2253 tempest-VolumesMetadataTest-324776193 None] Created volume successfully. Aug 25 06:57:38 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833" returned: 0 in 0.605s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:57:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7986a13d-1ac2-4b3d-b676-8ad075e08fff]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:38 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 Aug 25 06:57:38 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:39 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" returned: 0 in 0.712s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:39 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 Aug 25 06:57:39 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:39 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833" returned: 0 in 0.588s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:39 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833 Aug 25 06:57:39 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Acquiring lock "cinder-ccc88db4-3841-42fd-a5a2-63e1dfd4e632-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Lock "cinder-ccc88db4-3841-42fd-a5a2-63e1dfd4e632-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Acquiring lock "cinder-quobyte-ccc88db4-3841-42fd-a5a2-63e1dfd4e632" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Lock "cinder-quobyte-ccc88db4-3841-42fd-a5a2-63e1dfd4e632" acquired by "delete_volume" :: waited 0.042s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[433bd150-70ca-461b-9667-ed5a0c8667c6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:40 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 Aug 25 06:57:40 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:40 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3.ce9ac493-ee61-4229-8413-305ebd0c0833" returned: 0 in 0.442s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-ce9ac493-ee61-4229-8413-305ebd0c0833" released by "_delete_snapshot" :: held 2.501s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" released by "delete_snapshot" :: held 2.540s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Created reservations ['e2bcfd33-50fd-4d94-87e9-703e51b83f57', '03604260-82bd-4615-9238-dd9797d5e9f3', '90a62c51-9c0e-40b8-8805-2d03da6d1d00', 'c427e244-df42-4d08-aa03-04f1d75dce41'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Delete snapshot completed successfully. Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-ce9ac493-ee61-4229-8413-305ebd0c0833-delete_snapshot" released by "delete_snapshot" :: held 2.834s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Snapshots deleted, issuing volume delete {{(pid=94460) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1030}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[681ad160-4817-4da5-a1b6-0ef07df3315b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:40 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632" returned: 0 in 0.709s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:40 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632 Aug 25 06:57:40 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:40 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 Aug 25 06:57:40 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:41 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ccc88db4-3841-42fd-a5a2-63e1dfd4e632" returned: 0 in 0.428s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:41 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" returned: 0 in 0.569s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Lock "cinder-quobyte-ccc88db4-3841-42fd-a5a2-63e1dfd4e632" released by "delete_volume" :: held 1.220s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:41 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3 Aug 25 06:57:41 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Created reservations ['9a3e6405-765e-4d73-88f2-b14de00cb29a', 'd83e90ab-de9b-4e7f-b67b-9bf65d892522', '90f23e62-131c-441c-8bc4-ac9ab8f77d9c', '0d64d174-142a-43a5-ab8d-b242ec166a13'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:41 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:41 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:41 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" returned: 0 in 0.381s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-c9ee2b48-8e66-43df-8c49-6b38803f8ad3" released by "delete_volume" :: held 1.070s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Created reservations ['6c5e0cfb-eade-474d-bc53-b8536e5e902f', '95552f9a-fd51-4ca4-af9c-a85a1c0d1f59', 'e1d53057-4658-40bf-8eb5-8ce126cac079', '98cbad5c-3eb1-40cc-bab4-293c8b155879'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:41 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Deleted volume successfully. Aug 25 06:57:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cf82b02-1fd0-43ac-927c-fa04cf8dc6fe tempest-VolumesMetadataTest-324776193 None] Lock "cinder-ccc88db4-3841-42fd-a5a2-63e1dfd4e632-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:41 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:41 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:42 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:42 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Deleted volume successfully. Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ae8004e-2f83-4bb7-907d-4f8bb2bda24a tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-c9ee2b48-8e66-43df-8c49-6b38803f8ad3-delete_volume" released by "delete_volume" :: held 4.589s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-8eef1402-40e0-4d2c-bfd8-1ed71e25d363-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-8eef1402-40e0-4d2c-bfd8-1ed71e25d363-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "cinder-quobyte-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db59603-bbd7-483c-98ae-75eae72ebd00]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:42 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 Aug 25 06:57:42 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:43 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" returned: 0 in 0.569s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:43 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363 Aug 25 06:57:43 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:43 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" returned: 0 in 0.258s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-quobyte-8eef1402-40e0-4d2c-bfd8-1ed71e25d363" released by "delete_volume" :: held 0.894s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Created reservations ['54d4e566-e272-4d9d-95ef-3f5973b7b81c', '3b23c90b-6008-41cb-980a-ab4de6eea915', 'bc81addd-fe9b-4e7d-acb1-5b6145f13c70', 'ad56bf80-15b7-4fc6-94fd-d3a182cfe782'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:43 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:43 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:43 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Deleted volume successfully. Aug 25 06:57:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3bad8f0-795c-4277-b7ad-15fcfd3efdb3 tempest-VolumesDeleteCascade-1714670895 None] Lock "cinder-8eef1402-40e0-4d2c-bfd8-1ed71e25d363-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:45 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Flow 'volume_create_manager' (7d947a15-c7b2-4233-92cf-2de32548652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f28eae-c507-4562-99ba-61b58d0bf720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f28eae-c507-4562-99ba-61b58d0bf720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-628718808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e5bd03-b10c-4b31-aea2-c6e8990a2d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec10a3b59b4152ae6d1f46af16ddb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:46Z,use_quota=True,user_id='7f744a2cd37749f39516c20221af6d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a352fd82-3fe6-436b-b6ab-dca5342f0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a352fd82-3fe6-436b-b6ab-dca5342f0f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3278c1e0-c08c-45bd-9829-0382140068a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3278c1e0-c08c-45bd-9829-0382140068a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e5bd03-b10c-4b31-aea2-c6e8990a2d39', 'volume_name': 'volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6474611a-a8bf-457d-853f-7e8c85290f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6474611a-a8bf-457d-853f-7e8c85290f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08ddf97-8fc5-4e23-be95-07259ab1af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Volume f7e5bd03-b10c-4b31-aea2-c6e8990a2d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39', 'volume_size': 1} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-628718808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e5bd03-b10c-4b31-aea2-c6e8990a2d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec10a3b59b4152ae6d1f46af16ddb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:46Z,use_quota=True,user_id='7f744a2cd37749f39516c20221af6d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Creating volume f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:46 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:46 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 1073741824 Aug 25 06:57:46 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Flow 'volume_create_manager' (75d3d61d-2f8a-4f5f-8109-c48d41476728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda01d47-e13f-4ff6-aad8-05f2b3007d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda01d47-e13f-4ff6-aad8-05f2b3007d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1447005163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a4a8ac-28e9-4043-aab2-65cc2a945b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec10a3b59b4152ae6d1f46af16ddb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:47Z,use_quota=True,user_id='7f744a2cd37749f39516c20221af6d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6e2bff-153c-4d29-9978-98d844d4640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6e2bff-153c-4d29-9978-98d844d4640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d4b50d-d900-4a1a-a5de-1f62876865b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d4b50d-d900-4a1a-a5de-1f62876865b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a4a8ac-28e9-4043-aab2-65cc2a945b68', 'volume_name': 'volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953b7dc0-e1ea-4f04-8082-ff1548b2cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953b7dc0-e1ea-4f04-8082-ff1548b2cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaf155a-9eda-4d7b-a87d-d5bb10fa92f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Volume b7a4a8ac-28e9-4043-aab2-65cc2a945b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68', 'volume_size': 1} Aug 25 06:57:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:47 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 1073741824" returned: 0 in 0.951s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:47 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 Aug 25 06:57:47 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:47 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39" returned: 0 in 0.570s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1447005163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a4a8ac-28e9-4043-aab2-65cc2a945b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec10a3b59b4152ae6d1f46af16ddb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:47Z,use_quota=True,user_id='7f744a2cd37749f39516c20221af6d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Creating volume b7a4a8ac-28e9-4043-aab2-65cc2a945b68 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:47 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08ddf97-8fc5-4e23-be95-07259ab1af37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc43035-31b4-4483-bc90-13f893400092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:47 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 1073741824 Aug 25 06:57:47 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:47 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Volume volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 (f7e5bd03-b10c-4b31-aea2-c6e8990a2d39): created successfully Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc43035-31b4-4483-bc90-13f893400092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Flow 'volume_create_manager' (7d947a15-c7b2-4233-92cf-2de32548652d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-51597224-f8d4-4ad6-a2b4-82e76d023983 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Created volume successfully. Aug 25 06:57:48 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 1073741824" returned: 0 in 0.860s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:48 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 Aug 25 06:57:48 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:49 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68" returned: 0 in 0.329s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaf155a-9eda-4d7b-a87d-d5bb10fa92f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b23078-1473-4f67-ac1b-614e3f03fee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Volume volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 (b7a4a8ac-28e9-4043-aab2-65cc2a945b68): created successfully Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b23078-1473-4f67-ac1b-614e3f03fee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Flow 'volume_create_manager' (75d3d61d-2f8a-4f5f-8109-c48d41476728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5b5f3d82-cac6-45a5-80b4-2187e822fd89 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Created volume successfully. Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Flow 'volume_create_manager' (e8fcbc03-c019-4541-9f1d-038792bf1117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed146f76-f5d0-42ce-8d7b-c33b8d4376ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed146f76-f5d0-42ce-8d7b-c33b8d4376ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1230089393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ffc583-0f24-4ecd-b8fc-754de3d7f653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fa6912f8a14bbdbbd902c600fb0ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:52Z,use_quota=True,user_id='a777d19c9e5b41ebb628c46df28894ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b626936-6ffe-4e24-977a-48e5fe9779c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b626936-6ffe-4e24-977a-48e5fe9779c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7bf058-7d1e-4c64-9e42-344e7893d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7bf058-7d1e-4c64-9e42-344e7893d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ffc583-0f24-4ecd-b8fc-754de3d7f653', 'volume_name': 'volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91d60d9-23e7-4aa0-820f-9498d50587f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91d60d9-23e7-4aa0-820f-9498d50587f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d372b34-2902-4b5c-9625-aff7ddbc94b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:52 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Volume 79ffc583-0f24-4ecd-b8fc-754de3d7f653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653', 'volume_size': 1} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1230089393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ffc583-0f24-4ecd-b8fc-754de3d7f653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fa6912f8a14bbdbbd902c600fb0ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:52Z,use_quota=True,user_id='a777d19c9e5b41ebb628c46df28894ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Creating volume 79ffc583-0f24-4ecd-b8fc-754de3d7f653 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:52 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:52 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 1073741824 Aug 25 06:57:52 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:57:53 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Flow 'volume_create_manager' (d2bccb5b-f697-4578-a788-84c8d66060a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a3c32e-3bd3-4d78-b93b-e27f11e78a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 1073741824" returned: 0 in 0.914s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a3c32e-3bd3-4d78-b93b-e27f11e78a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-278892883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a14076-6484-443a-8be2-d1633792c6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7499bd26dc28401ab8e98fdb006b06e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:53Z,use_quota=True,user_id='78b451fb4fca4488be87962f7e118399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326a9f5-7b2b-431d-b8ad-f990a87678f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326a9f5-7b2b-431d-b8ad-f990a87678f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acee945-fbcd-4e50-9429-32c39cfa0c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acee945-fbcd-4e50-9429-32c39cfa0c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a14076-6484-443a-8be2-d1633792c6e8', 'volume_name': 'volume-04a14076-6484-443a-8be2-d1633792c6e8', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03be905f-5392-4424-acef-2a9f100cace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03be905f-5392-4424-acef-2a9f100cace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f37f3ca-92bb-4210-af3c-ab9a2dfe8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Volume 04a14076-6484-443a-8be2-d1633792c6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a14076-6484-443a-8be2-d1633792c6e8', 'volume_size': 1} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:53 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 Aug 25 06:57:53 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:53 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-278892883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a14076-6484-443a-8be2-d1633792c6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7499bd26dc28401ab8e98fdb006b06e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:57:53Z,use_quota=True,user_id='78b451fb4fca4488be87962f7e118399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Creating volume 04a14076-6484-443a-8be2-d1633792c6e8 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:57:53 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d372b34-2902-4b5c-9625-aff7ddbc94b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:53 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 1073741824 Aug 25 06:57:53 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83097624-7de2-4915-a3af-5f428ed57ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Volume volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 (79ffc583-0f24-4ecd-b8fc-754de3d7f653): created successfully Aug 25 06:57:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83097624-7de2-4915-a3af-5f428ed57ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Flow 'volume_create_manager' (e8fcbc03-c019-4541-9f1d-038792bf1117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-56e5a0b8-3d5d-4853-a4bb-573a4f4cce83 tempest-VolumesTransfersTest-1832311222 None] Created volume successfully. Aug 25 06:57:54 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 1073741824" returned: 0 in 0.755s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:54 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 Aug 25 06:57:54 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:55 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8" returned: 0 in 0.480s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f37f3ca-92bb-4210-af3c-ab9a2dfe8908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a14076-6484-443a-8be2-d1633792c6e8', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd26209d-d3b1-4253-8984-474023afc11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:57:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Volume volume-04a14076-6484-443a-8be2-d1633792c6e8 (04a14076-6484-443a-8be2-d1633792c6e8): created successfully Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd26209d-d3b1-4253-8984-474023afc11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:57:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Flow 'volume_create_manager' (d2bccb5b-f697-4578-a788-84c8d66060a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:57:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-99d11f3b-708c-439f-90a9-f40553822bc1 tempest-VolumesTransfersV355Test-100184155 None] Created volume successfully. Aug 25 06:57:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-11a3bbc5-341a-47b3-8d38-b8917bec908c tempest-VolumesTransfersTest-380831118 None] Transfer volume completed successfully. Aug 25 06:57:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Acquiring lock "cinder-79ffc583-0f24-4ecd-b8fc-754de3d7f653-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-79ffc583-0f24-4ecd-b8fc-754de3d7f653-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Acquiring lock "cinder-quobyte-79ffc583-0f24-4ecd-b8fc-754de3d7f653" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-quobyte-79ffc583-0f24-4ecd-b8fc-754de3d7f653" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ffaa74-b9bd-454c-bcb4-62be9c6d414a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:56 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 Aug 25 06:57:56 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:57 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653" returned: 0 in 0.503s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:57 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653 Aug 25 06:57:57 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8cf55769-76ee-41b9-9717-8426f71d4587 tempest-VolumesTransfersV355Test-1585673562 None] Transfer volume completed successfully. Aug 25 06:57:57 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-79ffc583-0f24-4ecd-b8fc-754de3d7f653" returned: 0 in 0.553s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-quobyte-79ffc583-0f24-4ecd-b8fc-754de3d7f653" released by "delete_volume" :: held 1.138s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Created reservations ['dd21874b-d992-4cf3-8464-f3b71d0ecbe4', 'a1de0768-2d4d-4f87-8c24-0e50a259af50', '2b739859-b962-4390-8ca1-07a85b3fe98e', '84c04d9b-f1e1-4ed2-b39c-fc04576c08c6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:57:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:57 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:57:57 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Acquiring lock "cinder-04a14076-6484-443a-8be2-d1633792c6e8-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-04a14076-6484-443a-8be2-d1633792c6e8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:58 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.871s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Acquiring lock "cinder-quobyte-04a14076-6484-443a-8be2-d1633792c6e8" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:57:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Deleted volume successfully. Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-quobyte-04a14076-6484-443a-8be2-d1633792c6e8" acquired by "delete_volume" :: waited 0.045s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7263ca0e-7107-4ee3-bdeb-cf19be52d644 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-79ffc583-0f24-4ecd-b8fc-754de3d7f653-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f50e472-8059-473b-82ff-ad4e6ed6c21d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:57:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:59 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 Aug 25 06:57:59 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:57:59 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 25 06:57:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8" returned: 0 in 0.956s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:57:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:57:59 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8 Aug 25 06:57:59 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Flow 'volume_create_manager' (fe69fbcb-dbae-47d0-9d13-f9b40de4dba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:00 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c57ab9-c335-4bda-a827-1fb84c21d75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-04a14076-6484-443a-8be2-d1633792c6e8" returned: 0 in 0.465s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c57ab9-c335-4bda-a827-1fb84c21d75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-77136773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcda7fe-796c-4052-8c9c-a6d54156b24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fa6912f8a14bbdbbd902c600fb0ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:00Z,use_quota=True,user_id='a777d19c9e5b41ebb628c46df28894ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162dc494-cd12-40d9-a7b1-32399e7c89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162dc494-cd12-40d9-a7b1-32399e7c89d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efd383d-0462-4438-9a1d-56d8a6f24c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efd383d-0462-4438-9a1d-56d8a6f24c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcda7fe-796c-4052-8c9c-a6d54156b24f', 'volume_name': 'volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f41f10-4a27-4c38-8048-264d029a957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f41f10-4a27-4c38-8048-264d029a957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850e152c-cf98-428c-8109-12242ccc13af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:00 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Volume 4fcda7fe-796c-4052-8c9c-a6d54156b24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f', 'volume_size': 1} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-77136773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcda7fe-796c-4052-8c9c-a6d54156b24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fa6912f8a14bbdbbd902c600fb0ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:00Z,use_quota=True,user_id='a777d19c9e5b41ebb628c46df28894ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Creating volume 4fcda7fe-796c-4052-8c9c-a6d54156b24f {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:00 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-quobyte-04a14076-6484-443a-8be2-d1633792c6e8" released by "delete_volume" :: held 1.606s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:00 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f 1073741824 Aug 25 06:58:00 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Created reservations ['1736503b-0fce-4ca7-989b-4109512c61ab', '334867f3-fddd-4f67-b790-4754399885bf', '4f42073f-cfcf-4d6f-9d53-f529c9ab464e', 'e4995832-b886-4732-8e0f-a51095f3aab2'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:00 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:00 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:00 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:00 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Deleted volume successfully. Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0e82e4df-edec-4d87-a63b-b4c21f111fb7 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-04a14076-6484-443a-8be2-d1633792c6e8-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:01 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f 1073741824" returned: 0 in 0.801s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:01 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f Aug 25 06:58:01 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:01 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f" returned: 0 in 0.621s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850e152c-cf98-428c-8109-12242ccc13af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5a22b3-b0e0-4ce6-9059-fad79a5383fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:01 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Volume volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f (4fcda7fe-796c-4052-8c9c-a6d54156b24f): created successfully Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5a22b3-b0e0-4ce6-9059-fad79a5383fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Flow 'volume_create_manager' (fe69fbcb-dbae-47d0-9d13-f9b40de4dba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4b0f39e8-c99a-47b5-87cb-723c27be99fc tempest-VolumesTransfersTest-1832311222 None] Created volume successfully. Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Flow 'volume_create_manager' (8f36b897-29a7-455d-a24b-4f9e0d1c8469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27881bdc-0291-4cf6-86ae-9fd1b8f24244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27881bdc-0291-4cf6-86ae-9fd1b8f24244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1188143041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57732982-0df3-4203-8dfa-7890fb35c3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7499bd26dc28401ab8e98fdb006b06e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:02Z,use_quota=True,user_id='78b451fb4fca4488be87962f7e118399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bedc48-f2b9-4e7e-bd27-ecbba6c8c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bedc48-f2b9-4e7e-bd27-ecbba6c8c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbe3fa-a63b-462d-9f05-cab5a0450bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbe3fa-a63b-462d-9f05-cab5a0450bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57732982-0df3-4203-8dfa-7890fb35c3ff', 'volume_name': 'volume-57732982-0df3-4203-8dfa-7890fb35c3ff', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9469f161-b493-4cf0-aa04-56f5103cc4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9469f161-b493-4cf0-aa04-56f5103cc4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909771d3-ee06-4dc6-a5cb-32e5beaa1fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Volume 57732982-0df3-4203-8dfa-7890fb35c3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57732982-0df3-4203-8dfa-7890fb35c3ff', 'volume_size': 1} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1188143041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57732982-0df3-4203-8dfa-7890fb35c3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7499bd26dc28401ab8e98fdb006b06e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:02Z,use_quota=True,user_id='78b451fb4fca4488be87962f7e118399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Creating volume 57732982-0df3-4203-8dfa-7890fb35c3ff {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:02 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:02 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff 1073741824 Aug 25 06:58:02 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Acquiring lock "cinder-4fcda7fe-796c-4052-8c9c-a6d54156b24f-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-4fcda7fe-796c-4052-8c9c-a6d54156b24f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Acquiring lock "cinder-quobyte-4fcda7fe-796c-4052-8c9c-a6d54156b24f" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:02 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-quobyte-4fcda7fe-796c-4052-8c9c-a6d54156b24f" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff 1073741824" returned: 0 in 0.853s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ef9c46-aa8b-4382-822a-38d90f4752e5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:03 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff Aug 25 06:58:03 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:03 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f Aug 25 06:58:03 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:03 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909771d3-ee06-4dc6-a5cb-32e5beaa1fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57732982-0df3-4203-8dfa-7890fb35c3ff', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49136b2-786b-4eee-9d5e-905966626a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:03 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Volume volume-57732982-0df3-4203-8dfa-7890fb35c3ff (57732982-0df3-4203-8dfa-7890fb35c3ff): created successfully Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49136b2-786b-4eee-9d5e-905966626a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Flow 'volume_create_manager' (8f36b897-29a7-455d-a24b-4f9e0d1c8469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-72bf29e1-bb07-48c1-bf3e-ff7063424909 tempest-VolumesTransfersV355Test-100184155 None] Created volume successfully. Aug 25 06:58:03 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f" returned: 0 in 0.573s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:03 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f Aug 25 06:58:03 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:03 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4fcda7fe-796c-4052-8c9c-a6d54156b24f" returned: 0 in 0.357s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-quobyte-4fcda7fe-796c-4052-8c9c-a6d54156b24f" released by "delete_volume" :: held 1.007s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Created reservations ['d0122e73-b494-4166-a605-a8dac266695a', '89979c89-b3bc-4d56-a022-e8e304bac653', '022b4978-9541-4905-89ba-255d0dfcf69b', '3dfea80b-2f3b-41fc-952a-cf6b8883e19f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:04 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:04 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Acquiring lock "cinder-57732982-0df3-4203-8dfa-7890fb35c3ff-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-57732982-0df3-4203-8dfa-7890fb35c3ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:04 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Acquiring lock "cinder-quobyte-57732982-0df3-4203-8dfa-7890fb35c3ff" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Deleted volume successfully. Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-quobyte-57732982-0df3-4203-8dfa-7890fb35c3ff" acquired by "delete_volume" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c574498f-afdb-4f68-8b7d-f0709234b321 tempest-VolumesTransfersTest-1885566491 None] Lock "cinder-4fcda7fe-796c-4052-8c9c-a6d54156b24f-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f75d6-c41a-43cd-87dd-48dfa2977b26]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:04 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff Aug 25 06:58:04 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:05 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff" returned: 0 in 0.397s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:05 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff Aug 25 06:58:05 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:05 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-57732982-0df3-4203-8dfa-7890fb35c3ff" returned: 0 in 0.286s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-quobyte-57732982-0df3-4203-8dfa-7890fb35c3ff" released by "delete_volume" :: held 0.745s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Created reservations ['db462b36-ccfe-413b-ac09-7dae47129104', 'dca32187-b307-4763-9b23-5c5088b08a42', '764ccfee-a514-4835-a40f-ac50096ff076', '606adc4e-60b5-4327-9d61-de0c39d802d7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:05 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:05 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:05 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.418s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:05 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Deleted volume successfully. Aug 25 06:58:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bdb63558-10d6-4190-893e-521cda57fdd5 tempest-VolumesTransfersV355Test-465739112 None] Lock "cinder-57732982-0df3-4203-8dfa-7890fb35c3ff-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Flow 'volume_create_manager' (f2e1312e-7d37-4b0a-ab29-3ba689ac6af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf88b1b-f406-4150-a20a-66d8e272a8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf88b1b-f406-4150-a20a-66d8e272a8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-190941373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffedf3c0-c8f4-41ab-a504-d04e7cb02af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c92375a03f74fa4b22a4f0ac34af4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:14Z,use_quota=True,user_id='ffb8ee3ba65e4bc7917609a506b973b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da206ea8-1948-4de4-a87f-98908392dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da206ea8-1948-4de4-a87f-98908392dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa11fda-44d8-4e92-8bfe-be281b07f327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa11fda-44d8-4e92-8bfe-be281b07f327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffedf3c0-c8f4-41ab-a504-d04e7cb02af1', 'volume_name': 'volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43fb013-7269-4ef9-924f-ff2bd2d959af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43fb013-7269-4ef9-924f-ff2bd2d959af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9504911-cf6a-46f9-9f82-eeee26aa39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:13 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Volume ffedf3c0-c8f4-41ab-a504-d04e7cb02af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1', 'volume_size': 1} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-190941373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffedf3c0-c8f4-41ab-a504-d04e7cb02af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c92375a03f74fa4b22a4f0ac34af4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:14Z,use_quota=True,user_id='ffb8ee3ba65e4bc7917609a506b973b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Creating volume ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:13 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:13 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 1073741824 Aug 25 06:58:13 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Flow 'volume_create_manager' (f12d7445-b093-43f9-9610-a6a8e1a11027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ebf528-8fd1-4d4e-9edb-7eb7eb9c0ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ebf528-8fd1-4d4e-9edb-7eb7eb9c0ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2022142784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98021ad-6b58-4bb7-bbc4-7bd747eb6be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b528140097024b928ceaf709430318e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:14Z,use_quota=True,user_id='fb728f29dcce405896e618dc93a7e718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e146687e-d1b3-4765-8667-23335250fba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e146687e-d1b3-4765-8667-23335250fba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5b6343-e32f-4ee4-b58a-f4065d0aaae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5b6343-e32f-4ee4-b58a-f4065d0aaae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'volume_name': 'volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fad9c04-8465-4d6e-842f-8567d9fc783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fad9c04-8465-4d6e-842f-8567d9fc783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44e9c80-fa8c-4d79-aa15-a122cbf40818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Volume c98021ad-6b58-4bb7-bbc4-7bd747eb6be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'volume_size': 1} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:14 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 1073741824" returned: 0 in 0.599s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:14 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 Aug 25 06:58:14 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Flow 'volume_create_manager' (df16c4c5-f6b1-409c-b63e-e36ae7e93081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d62edb9-a7e5-458c-a190-9a5ae9c137ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d62edb9-a7e5-458c-a190-9a5ae9c137ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-340352612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa05fe09-9071-4da4-8b79-cf7955ec85d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8982e8eadc14a3dbd1c316bc1a7058c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:15Z,use_quota=True,user_id='1a6fce4ae7b748caae0c0f211e2964fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e254e1-62d7-40c1-96fa-435accbce554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e254e1-62d7-40c1-96fa-435accbce554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930cdb2b-ac6a-4e1e-aed9-fea34b471d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930cdb2b-ac6a-4e1e-aed9-fea34b471d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa05fe09-9071-4da4-8b79-cf7955ec85d3', 'volume_name': 'volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2459b39d-f358-42dc-b9a4-eb0159ca2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2459b39d-f358-42dc-b9a4-eb0159ca2522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c3efc2-67d1-4fe8-b9a0-6055c0b3b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Volume aa05fe09-9071-4da4-8b79-cf7955ec85d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3', 'volume_size': 1} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:14 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2022142784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98021ad-6b58-4bb7-bbc4-7bd747eb6be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b528140097024b928ceaf709430318e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:14Z,use_quota=True,user_id='fb728f29dcce405896e618dc93a7e718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Creating volume c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:14 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9504911-cf6a-46f9-9f82-eeee26aa39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 1073741824 Aug 25 06:58:14 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306064f9-eb9c-46db-96bb-67ed93137e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Volume volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 (ffedf3c0-c8f4-41ab-a504-d04e7cb02af1): created successfully Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306064f9-eb9c-46db-96bb-67ed93137e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Flow 'volume_create_manager' (f2e1312e-7d37-4b0a-ab29-3ba689ac6af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:14 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d74d431f-6746-4755-80e7-7029684c6d37 tempest-AttachVolumeNegativeTest-634367111 None] Created volume successfully. Aug 25 06:58:15 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 1073741824" returned: 0 in 0.429s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:15 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 Aug 25 06:58:15 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:15 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" returned: 0 in 0.240s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-340352612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa05fe09-9071-4da4-8b79-cf7955ec85d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8982e8eadc14a3dbd1c316bc1a7058c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:15Z,use_quota=True,user_id='1a6fce4ae7b748caae0c0f211e2964fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Creating volume aa05fe09-9071-4da4-8b79-cf7955ec85d3 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:15 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:15 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 1073741824 Aug 25 06:58:15 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44e9c80-fa8c-4d79-aa15-a122cbf40818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d46503-cf43-4a6b-83b9-c198724c1d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:15 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Volume volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 (c98021ad-6b58-4bb7-bbc4-7bd747eb6be8): created successfully Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d46503-cf43-4a6b-83b9-c198724c1d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Flow 'volume_create_manager' (f12d7445-b093-43f9-9610-a6a8e1a11027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cc003639-7498-447d-b59e-72895b475e2e tempest-VolumesCloneTest-1274136281 None] Created volume successfully. Aug 25 06:58:16 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 1073741824" returned: 0 in 0.489s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:16 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 Aug 25 06:58:16 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:16 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3" returned: 0 in 0.330s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c3efc2-67d1-4fe8-b9a0-6055c0b3b071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fd1d5f-a83c-4641-95ab-e91c30c70d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Volume volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 (aa05fe09-9071-4da4-8b79-cf7955ec85d3): created successfully Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fd1d5f-a83c-4641-95ab-e91c30c70d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Flow 'volume_create_manager' (df16c4c5-f6b1-409c-b63e-e36ae7e93081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1b35e2ba-eaf6-4b7e-812e-d6f2028f690f tempest-VolumesTransfersV357Test-1729390326 None] Created volume successfully. Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-8023db24-3c49-4fa8-80cc-5b530d20049d req-91dc11cc-d876-4a6f-b79a-157dcb0634f8 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-8023db24-3c49-4fa8-80cc-5b530d20049d req-91dc11cc-d876-4a6f-b79a-157dcb0634f8 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-8023db24-3c49-4fa8-80cc-5b530d20049d req-91dc11cc-d876-4a6f-b79a-157dcb0634f8 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Flow 'volume_create_manager' (5f16491e-bb4c-40b6-b7e0-944913b2fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7093c695-ccb5-46a2-9f8a-0839166a52e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7093c695-ccb5-46a2-9f8a-0839166a52e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1549765262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e57cac-72e0-467f-881c-7729a142c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b528140097024b928ceaf709430318e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c98021ad-6b58-4bb7-bbc4-7bd747eb6be8,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:17Z,use_quota=True,user_id='fb728f29dcce405896e618dc93a7e718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048adb86-5de3-453d-80ba-52adc25c15f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048adb86-5de3-453d-80ba-52adc25c15f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30dde32-8e01-40d7-b0cd-5be9375c5bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30dde32-8e01-40d7-b0cd-5be9375c5bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '31e57cac-72e0-467f-881c-7729a142c973', 'volume_name': 'volume-31e57cac-72e0-467f-881c-7729a142c973', 'volume_size': 2, 'source_volid': 'c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'source_volstatus': 'available'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0735fc-8345-4909-bb53-f4144e6fbd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0735fc-8345-4909-bb53-f4144e6fbd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6db5d6-d0b6-4eb6-9149-8b31a22e4fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Volume 31e57cac-72e0-467f-881c-7729a142c973: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-31e57cac-72e0-467f-881c-7729a142c973', 'volume_size': 2, 'source_volid': 'c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'source_volstatus': 'available'} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-8023db24-3c49-4fa8-80cc-5b530d20049d req-91dc11cc-d876-4a6f-b79a-157dcb0634f8 tempest-AttachVolumeNegativeTest-634367111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c60ed19b-2489-4ba2-bde9-bafe98288a09', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:16 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Cloning volume c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 to volume 31e57cac-72e0-467f-881c-7729a142c973 Aug 25 06:58:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Creating offline snapshot 0fa3e434-7193-4a9d-afa0-4de2e12c7602 of volume c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:58:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[875f855c-bfc8-401f-a2c9-a17a2fe38b73]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-8023db24-3c49-4fa8-80cc-5b530d20049d req-91dc11cc-d876-4a6f-b79a-157dcb0634f8 tempest-AttachVolumeNegativeTest-634367111 None] attachment_update completed successfully. Aug 25 06:58:17 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 Aug 25 06:58:17 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:17 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b3eb87fd-d4eb-4370-b4c3-49fd06618559 tempest-VolumesTransfersV357Test-1007699599 None] Transfer volume completed successfully. Aug 25 06:58:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" returned: 0 in 0.449s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:17 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 1G Aug 25 06:58:17 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 1G" returned: 0 in 0.557s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 Aug 25 06:58:18 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Acquiring lock "cinder-aa05fe09-9071-4da4-8b79-cf7955ec85d3-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-aa05fe09-9071-4da4-8b79-cf7955ec85d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Acquiring lock "cinder-quobyte-aa05fe09-9071-4da4-8b79-cf7955ec85d3" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-quobyte-aa05fe09-9071-4da4-8b79-cf7955ec85d3" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d9d59-52cb-4762-bb66-3cc7c169aa35]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 Aug 25 06:58:18 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 is being set with open permissions: ugo+rw Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 Aug 25 06:58:18 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3" returned: 0 in 0.370s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3 Aug 25 06:58:18 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:18 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info Aug 25 06:58:18 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:18 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aa05fe09-9071-4da4-8b79-cf7955ec85d3" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-quobyte-aa05fe09-9071-4da4-8b79-cf7955ec85d3" released by "delete_volume" :: held 0.716s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Created reservations ['634adfa3-b8de-45ee-9c97-5a817f7965c4', '570473bb-9a6b-4653-aed1-617904e582f8', 'fbf80610-d214-4f4c-a948-c459f5d776fa', '0355471d-ecd7-4ffc-98b1-3705ca52950a'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:18 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info" returned: 0 in 0.310s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:18 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info is being set with open permissions: ugo+rw Aug 25 06:58:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info Aug 25 06:58:19 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:19 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.info" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "cinder-quobyte-31e57cac-72e0-467f-881c-7729a142c973" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-31e57cac-72e0-467f-881c-7729a142c973" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] snapshot: 0fa3e434-7193-4a9d-afa0-4de2e12c7602, volume: 31e57cac-72e0-467f-881c-7729a142c973, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:19 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.330s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b5258d-2bed-406d-ba4b-e807f472f405]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Deleted volume successfully. Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-036af106-34f2-46bf-ab79-f75d35bbe80b tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-aa05fe09-9071-4da4-8b79-cf7955ec85d3-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:19 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 Aug 25 06:58:19 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:19 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602" returned: 0 in 0.477s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Flow 'volume_create_manager' (d8ce0b49-fc95-495c-b235-4bc6290aa8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db275670-90f0-4dd2-837d-20c91b43211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d13ca-5c60-4ec8-9743-362dc94aad37]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db275670-90f0-4dd2-837d-20c91b43211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-822367291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90def5d0-ea76-4d0e-83aa-3ce10d80b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8982e8eadc14a3dbd1c316bc1a7058c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:20Z,use_quota=True,user_id='1a6fce4ae7b748caae0c0f211e2964fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76106d5-963a-4f6a-af15-82536461c252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76106d5-963a-4f6a-af15-82536461c252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac8ea26-8273-4237-a6e8-696b28883827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac8ea26-8273-4237-a6e8-696b28883827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90def5d0-ea76-4d0e-83aa-3ce10d80b78e', 'volume_name': 'volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3701c03e-3a6b-4d8a-b4e8-f10e799ae0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3701c03e-3a6b-4d8a-b4e8-f10e799ae0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00db8beb-a4ed-4334-ab49-4f1723b2d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Volume 90def5d0-ea76-4d0e-83aa-3ce10d80b78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e', 'volume_size': 1} Aug 25 06:58:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:20 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 Aug 25 06:58:20 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:20 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" returned: 0 in 0.372s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 06:58:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 06:58:20 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 06:58:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:20 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 Aug 25 06:58:20 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:26 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973" returned: 0 in 5.769s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:58:26 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Converted 1024.00 MB image at 177.45 MB/s Aug 25 06:58:26 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 is being set with open permissions: ugo+rw Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:26 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 Aug 25 06:58:26 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:26 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973" returned: 0 in 0.333s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-31e57cac-72e0-467f-881c-7729a142c973" released by "_copy_volume_from_snapshot" :: held 7.095s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "cinder-quobyte-0fa3e434-7193-4a9d-afa0-4de2e12c7602" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-0fa3e434-7193-4a9d-afa0-4de2e12c7602" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Deleting offline snapshot 0fa3e434-7193-4a9d-afa0-4de2e12c7602 of volume c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] snapshot_file for this snap is: volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18097e4-0ac7-4b4d-aea0-163b21b9df1f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:26 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 Aug 25 06:58:26 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:27 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602" returned: 0 in 0.507s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7818c63e-b524-4980-b193-2cf8f0c5ab30]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-274b9d0f-464a-48df-991c-7b11c5e3d8f3 req-08d6912e-ecbc-4e8a-92cd-1e8b6fef5a07 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:27 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 Aug 25 06:58:27 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:27 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" returned: 0 in 0.648s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:27 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 Aug 25 06:58:27 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:28 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602" returned: 0 in 0.377s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:28 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602 Aug 25 06:58:28 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:28 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8.0fa3e434-7193-4a9d-afa0-4de2e12c7602" returned: 0 in 0.282s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-0fa3e434-7193-4a9d-afa0-4de2e12c7602" released by "_delete_snapshot" :: held 1.940s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.510s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.469s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-822367291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90def5d0-ea76-4d0e-83aa-3ce10d80b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8982e8eadc14a3dbd1c316bc1a7058c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:20Z,use_quota=True,user_id='1a6fce4ae7b748caae0c0f211e2964fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Creating volume 90def5d0-ea76-4d0e-83aa-3ce10d80b78e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:28 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:28 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e 1073741824 Aug 25 06:58:28 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6db5d6-d0b6-4eb6-9149-8b31a22e4fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e57cac-72e0-467f-881c-7729a142c973', 'volume_size': 2, 'source_volid': 'c98021ad-6b58-4bb7-bbc4-7bd747eb6be8', 'source_volstatus': 'available'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe3ff2e-fd8c-469e-a061-66512c0d05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:28 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Volume volume-31e57cac-72e0-467f-881c-7729a142c973 (31e57cac-72e0-467f-881c-7729a142c973): created successfully Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe3ff2e-fd8c-469e-a061-66512c0d05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Flow 'volume_create_manager' (5f16491e-bb4c-40b6-b7e0-944913b2fb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6f11619f-c999-49fb-8be5-6ef8e5d78184 tempest-VolumesCloneTest-1274136281 None] Created volume successfully. Aug 25 06:58:29 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e 1073741824" returned: 0 in 0.556s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:29 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e Aug 25 06:58:29 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Acquiring lock "cinder-31e57cac-72e0-467f-881c-7729a142c973-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Lock "cinder-31e57cac-72e0-467f-881c-7729a142c973-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Acquiring lock "cinder-quobyte-31e57cac-72e0-467f-881c-7729a142c973" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-31e57cac-72e0-467f-881c-7729a142c973" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:29 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e80761-44fb-4c00-bd35-9267558bdcea]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e" returned: 0 in 0.514s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-274b9d0f-464a-48df-991c-7b11c5e3d8f3 req-08d6912e-ecbc-4e8a-92cd-1e8b6fef5a07 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.530s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00db8beb-a4ed-4334-ab49-4f1723b2d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ca5724-a992-42c8-b3ed-0a37798d25d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-274b9d0f-464a-48df-991c-7b11c5e3d8f3 req-08d6912e-ecbc-4e8a-92cd-1e8b6fef5a07 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:29 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Volume volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e (90def5d0-ea76-4d0e-83aa-3ce10d80b78e): created successfully Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ca5724-a992-42c8-b3ed-0a37798d25d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Flow 'volume_create_manager' (d8ce0b49-fc95-495c-b235-4bc6290aa8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:29 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8c22b103-8a91-45b5-8056-468ae9967afa tempest-VolumesTransfersV357Test-1729390326 None] Created volume successfully. Aug 25 06:58:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-274b9d0f-464a-48df-991c-7b11c5e3d8f3 req-08d6912e-ecbc-4e8a-92cd-1e8b6fef5a07 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93fd0119-2195-4bbd-a0b5-c01b5508974f', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:58:29 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 Aug 25 06:58:29 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:29 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-274b9d0f-464a-48df-991c-7b11c5e3d8f3 req-08d6912e-ecbc-4e8a-92cd-1e8b6fef5a07 tempest-TestServerVolumeAttachmentScenario-1500397123 None] attachment_update completed successfully. Aug 25 06:58:30 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973" returned: 0 in 0.627s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:30 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973 Aug 25 06:58:30 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Acquiring lock "cinder-90def5d0-ea76-4d0e-83aa-3ce10d80b78e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-90def5d0-ea76-4d0e-83aa-3ce10d80b78e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:30 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-31e57cac-72e0-467f-881c-7729a142c973" returned: 0 in 0.446s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-31e57cac-72e0-467f-881c-7729a142c973" released by "delete_volume" :: held 1.123s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Acquiring lock "cinder-quobyte-90def5d0-ea76-4d0e-83aa-3ce10d80b78e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-quobyte-90def5d0-ea76-4d0e-83aa-3ce10d80b78e" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb94fc1-d9ef-4653-b7fc-5fb9568d0dc9]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Created reservations ['aef2fb0c-5aea-4dda-90f1-3c3a772d62c2', 'd1d13637-e727-4d38-a87a-144ccf1bb64c', '68a526e8-7877-4fca-bdaa-7d030b9b0de3', '78fb0069-0344-4638-bea2-d2439eea45da'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:30 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e Aug 25 06:58:30 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:30 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:30 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:31 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e" returned: 0 in 0.521s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:31 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:31 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Deleted volume successfully. Aug 25 06:58:31 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e Aug 25 06:58:31 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-63c1b218-3f84-4a51-817b-b52aa7724e3f tempest-VolumesCloneTest-1274136281 None] Lock "cinder-31e57cac-72e0-467f-881c-7729a142c973-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:31 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-90def5d0-ea76-4d0e-83aa-3ce10d80b78e" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-quobyte-90def5d0-ea76-4d0e-83aa-3ce10d80b78e" released by "delete_volume" :: held 0.951s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:31 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:31 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Created reservations ['1e7bd074-c626-4258-9f0d-291b15523701', 'e7c81c2d-dda6-4b88-a072-63312a136a60', '2b4e56a2-c921-42df-a315-dc2b7eb9f35a', '1db4f984-e46b-4de1-b9e7-da850371d268'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "cinder-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "cinder-quobyte-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" acquired by "delete_volume" :: waited 0.095s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:32 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:32 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d7ae6-561c-46c1-a41f-72d7323299b7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.647s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:58:32 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:58:32 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 Aug 25 06:58:32 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:32 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.425s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Deleted volume successfully. Aug 25 06:58:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-73b3b84a-b9c8-4686-917a-d46999b025bb tempest-VolumesTransfersV357Test-1896608850 None] Lock "cinder-90def5d0-ea76-4d0e-83aa-3ce10d80b78e-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:33 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" returned: 0 in 0.719s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:33 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8 Aug 25 06:58:33 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:33 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" returned: 0 in 0.489s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-quobyte-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8" released by "delete_volume" :: held 1.317s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Created reservations ['bbbb1fd9-1990-4974-8e57-36fe1ed0862b', 'd5244a32-1cc0-4cc4-92e0-76b0fa7c0124', 'b4392997-de58-449c-ad32-9765f4ce85e6', '4cf4aca1-88a1-4fcb-b385-2429417decc9'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:33 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:33 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:34 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.437s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:34 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Deleted volume successfully. Aug 25 06:58:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8128166d-393b-4f9d-8d86-2e8401380965 tempest-VolumesCloneTest-1274136281 None] Lock "cinder-c98021ad-6b58-4bb7-bbc4-7bd747eb6be8-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:38 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=97,cinder:INSERT=33,cinder:UPDATE=130,cinder:DELETE=8 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:58:38 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=141,cinder:DELETE=16,cinder:SELECT=109,cinder:INSERT=30 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:58:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-c6e8fcc0-6194-4ea4-b5c5-456db47cc724 req-0fc02a16-905e-405d-a336-4f30c9b9f44c tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-c6e8fcc0-6194-4ea4-b5c5-456db47cc724 req-0fc02a16-905e-405d-a336-4f30c9b9f44c tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-c6e8fcc0-6194-4ea4-b5c5-456db47cc724 req-0fc02a16-905e-405d-a336-4f30c9b9f44c tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-c6e8fcc0-6194-4ea4-b5c5-456db47cc724 req-0fc02a16-905e-405d-a336-4f30c9b9f44c tempest-TestServerVolumeAttachmentScenario-1500397123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fcbbe3a-7729-4e07-ad63-f9e68eab6e9f', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:58:38 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-c6e8fcc0-6194-4ea4-b5c5-456db47cc724 req-0fc02a16-905e-405d-a336-4f30c9b9f44c tempest-TestServerVolumeAttachmentScenario-1500397123 None] attachment_update completed successfully. Aug 25 06:58:40 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Flow 'volume_create_manager' (55d8ae75-5f0e-4ab4-8738-7bc8501f9564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a46ac4e-2e18-4f3b-abb8-c7f964c91d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a46ac4e-2e18-4f3b-abb8-c7f964c91d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-652774426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89bc042-44cf-4758-9a36-5d6dde8de721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e65d0bdb2bd4822899c233c877bfb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:41Z,use_quota=True,user_id='787ac8edae4940acbcb976a95c227593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5fe4bf-393d-4fcf-a872-61713e1beaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5fe4bf-393d-4fcf-a872-61713e1beaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c60a609-bab8-4f14-929a-b95d49dda935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 06:58:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-65a3d751-2c49-403a-b54e-0d328d54bf0b req-0640282d-4b62-4811-bcd0-4f57ac33d218 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Terminate volume connection completed successfully. Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-65a3d751-2c49-403a-b54e-0d328d54bf0b req-0640282d-4b62-4811-bcd0-4f57ac33d218 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Deleting attachment 0fcbbe3a-7729-4e07-ad63-f9e68eab6e9f. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c60a609-bab8-4f14-929a-b95d49dda935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a89bc042-44cf-4758-9a36-5d6dde8de721', 'volume_name': 'volume-a89bc042-44cf-4758-9a36-5d6dde8de721', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c089134-b9e0-4036-ae0d-b5c08accff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c089134-b9e0-4036-ae0d-b5c08accff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171e13d0-855e-44d9-86cb-28a1bfe255d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Volume a89bc042-44cf-4758-9a36-5d6dde8de721: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a89bc042-44cf-4758-9a36-5d6dde8de721', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 06:58:41 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Trying to clone a89bc042-44cf-4758-9a36-5d6dde8de721 from image d970149c-5c62-44a8-b2c8-06c24c805604 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 06:58:42 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Image download 20.69 MB at 20.69 MB/s Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05866d5-6cce-493f-8935-f593922fc30c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:42 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD Aug 25 06:58:42 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:42 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 is fetched for user 787ac8edae4940acbcb976a95c227593. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d355a63-509c-40fc-a126-4c0e7b2db720]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Flow 'volume_create_manager' (1b1683b7-ab37-4d64-9a0f-74db8d7792b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbc7194-63dc-47c7-af47-20a8606b0aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD Aug 25 06:58:43 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbc7194-63dc-47c7-af47-20a8606b0aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1386015524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e206d301-d7eb-4bfe-aaa5-0139bc158ba2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3870e959bb6c4180b2cbd337a906149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:43Z,use_quota=True,user_id='8dcec740d9444ecf840bcc4a04372765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d04975-2700-4c67-998d-118f1f8f20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d04975-2700-4c67-998d-118f1f8f20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f1aa88-853d-4f64-9768-734bfcb4e3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f1aa88-853d-4f64-9768-734bfcb4e3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e206d301-d7eb-4bfe-aaa5-0139bc158ba2', 'volume_name': 'volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a96bd45-bbd4-4eba-a2f9-111eac12ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a96bd45-bbd4-4eba-a2f9-111eac12ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bc3de2-e856-48bb-be32-113780baa800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:43 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Volume e206d301-d7eb-4bfe-aaa5-0139bc158ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2', 'volume_size': 1} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1386015524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e206d301-d7eb-4bfe-aaa5-0139bc158ba2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3870e959bb6c4180b2cbd337a906149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:43Z,use_quota=True,user_id='8dcec740d9444ecf840bcc4a04372765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Creating volume e206d301-d7eb-4bfe-aaa5-0139bc158ba2 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:43 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:43 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 1073741824 Aug 25 06:58:43 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:43 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-b0d52bf8-dc90-4d20-997a-279cc7aa62a9 req-c8c467fd-a4b6-4b63-9be5-a2b53ad6a323 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Terminate volume connection completed successfully. Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-b0d52bf8-dc90-4d20-997a-279cc7aa62a9 req-c8c467fd-a4b6-4b63-9be5-a2b53ad6a323 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Deleting attachment 93fd0119-2195-4bbd-a0b5-c01b5508974f. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:58:43 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 1073741824" returned: 0 in 0.558s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:43 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 Aug 25 06:58:43 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:44 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2" returned: 0 in 0.362s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-652774426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89bc042-44cf-4758-9a36-5d6dde8de721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e65d0bdb2bd4822899c233c877bfb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:41Z,use_quota=True,user_id='787ac8edae4940acbcb976a95c227593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Creating volume a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:44 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bc3de2-e856-48bb-be32-113780baa800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca33dc0f-a484-4e23-a044-d14024d60e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:44 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 1073741824 Aug 25 06:58:44 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:44 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Volume volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 (e206d301-d7eb-4bfe-aaa5-0139bc158ba2): created successfully Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca33dc0f-a484-4e23-a044-d14024d60e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Flow 'volume_create_manager' (1b1683b7-ab37-4d64-9a0f-74db8d7792b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0dde072f-63b3-4603-94d7-4b271787ead4 tempest-VolumesListTestJSON-258504541 None] Created volume successfully. Aug 25 06:58:44 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 1073741824" returned: 0 in 0.809s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:45 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 Aug 25 06:58:45 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:45 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721" returned: 0 in 0.358s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Attempting download of d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume a89bc042-44cf-4758-9a36-5d6dde8de721. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a0befc-4233-489f-80e4-52d344b54faa]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:45 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3 Aug 25 06:58:45 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:45 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:46 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Flow 'volume_create_manager' (25b9feec-b3e3-4694-b582-2681dc58c5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a01ece-d007-4ea9-a219-133657096331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3" returned: 0 in 0.433s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a01ece-d007-4ea9-a219-133657096331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1464007829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec94daf4-664d-4c4d-a362-c637be1df965,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3870e959bb6c4180b2cbd337a906149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:46Z,use_quota=True,user_id='8dcec740d9444ecf840bcc4a04372765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9f2bff-aa3a-4e19-b1f5-396f205e9651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9f2bff-aa3a-4e19-b1f5-396f205e9651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f886e-ca70-4ad3-8a34-aef9d064ba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f886e-ca70-4ad3-8a34-aef9d064ba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec94daf4-664d-4c4d-a362-c637be1df965', 'volume_name': 'volume-ec94daf4-664d-4c4d-a362-c637be1df965', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec63138-fdb3-4ad5-ba4e-26cf0a9b82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec63138-fdb3-4ad5-ba4e-26cf0a9b82fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269d9559-839f-4659-8428-6b286606180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Volume ec94daf4-664d-4c4d-a362-c637be1df965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec94daf4-664d-4c4d-a362-c637be1df965', 'volume_size': 1} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1464007829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec94daf4-664d-4c4d-a362-c637be1df965,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3870e959bb6c4180b2cbd337a906149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:46Z,use_quota=True,user_id='8dcec740d9444ecf840bcc4a04372765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Creating volume ec94daf4-664d-4c4d-a362-c637be1df965 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:46 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:46 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3 Aug 25 06:58:46 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:46 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 1073741824 Aug 25 06:58:46 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:46 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3" returned: 1 in 0.416s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_fwhwepd3' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a683e-cee9-4d09-adae-2835514c063f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:46 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD Aug 25 06:58:46 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:46 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 1073741824" returned: 0 in 0.541s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:46 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 Aug 25 06:58:46 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:46 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] d970149c-5c62-44a8-b2c8-06c24c805604 was qcow2, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 06:58:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:46 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 Aug 25 06:58:46 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:47 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965" returned: 0 in 0.329s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269d9559-839f-4659-8428-6b286606180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec94daf4-664d-4c4d-a362-c637be1df965', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99d0d90-0c6a-4f4f-af7f-8a3a7aa36293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:47 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Volume volume-ec94daf4-664d-4c4d-a362-c637be1df965 (ec94daf4-664d-4c4d-a362-c637be1df965): created successfully Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99d0d90-0c6a-4f4f-af7f-8a3a7aa36293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Flow 'volume_create_manager' (25b9feec-b3e3-4694-b582-2681dc58c5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9cbec346-2d70-4dfa-bf2e-9d8999fcc09b tempest-VolumesListTestJSON-258504541 None] Created volume successfully. Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Flow 'volume_create_manager' (48da6288-3ebd-480d-adc3-18efb10ef2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d9e8f5-f478-4cb1-a683-dc7838b78fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d9e8f5-f478-4cb1-a683-dc7838b78fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1200052471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65adda74-aaa6-4958-9bb4-4d57b0d37a40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3870e959bb6c4180b2cbd337a906149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:49Z,use_quota=True,user_id='8dcec740d9444ecf840bcc4a04372765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056e77d5-d7a4-43c7-8949-a7f59e67e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056e77d5-d7a4-43c7-8949-a7f59e67e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35025564-f70b-4695-a35e-4b85ff8a21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35025564-f70b-4695-a35e-4b85ff8a21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65adda74-aaa6-4958-9bb4-4d57b0d37a40', 'volume_name': 'volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535c411f-9b59-44eb-b1ea-775b500942e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535c411f-9b59-44eb-b1ea-775b500942e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97f534c-ec60-48c3-af41-5f99f8f465d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:48 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Volume 65adda74-aaa6-4958-9bb4-4d57b0d37a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40', 'volume_size': 1} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1200052471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65adda74-aaa6-4958-9bb4-4d57b0d37a40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3870e959bb6c4180b2cbd337a906149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:49Z,use_quota=True,user_id='8dcec740d9444ecf840bcc4a04372765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Creating volume 65adda74-aaa6-4958-9bb4-4d57b0d37a40 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:48 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:48 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 1073741824 Aug 25 06:58:48 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:48 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721" returned: 0 in 1.932s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_esg6ze7wdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 06:58:48 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Converted 112.00 MB image at 57.92 MB/s Aug 25 06:58:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:48 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 1G Aug 25 06:58:48 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:49 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 1G" returned: 0 in 0.374s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Downloaded image d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume a89bc042-44cf-4758-9a36-5d6dde8de721 successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 for user 787ac8edae4940acbcb976a95c227593 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Marking volume a89bc042-44cf-4758-9a36-5d6dde8de721 as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 06:58:49 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 1073741824" returned: 0 in 0.480s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Copying metadata from image d970149c-5c62-44a8-b2c8-06c24c805604 to a89bc042-44cf-4758-9a36-5d6dde8de721. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Creating volume glance metadata for volume a89bc042-44cf-4758-9a36-5d6dde8de721 backed by image d970149c-5c62-44a8-b2c8-06c24c805604 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:49 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 Aug 25 06:58:49 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "cinder-b7a4a8ac-28e9-4043-aab2-65cc2a945b68-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171e13d0-855e-44d9-86cb-28a1bfe255d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89bc042-44cf-4758-9a36-5d6dde8de721', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b988e0-eede-49cc-8f17-38d47e6e931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-b7a4a8ac-28e9-4043-aab2-65cc2a945b68-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Volume volume-a89bc042-44cf-4758-9a36-5d6dde8de721 (a89bc042-44cf-4758-9a36-5d6dde8de721): created successfully Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b988e0-eede-49cc-8f17-38d47e6e931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Flow 'volume_create_manager' (55d8ae75-5f0e-4ab4-8738-7bc8501f9564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9177ad17-ddc2-480a-891e-05d85135f214 tempest-VolumesExtendTest-516392768 None] Created volume successfully. Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "cinder-quobyte-b7a4a8ac-28e9-4043-aab2-65cc2a945b68" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-quobyte-b7a4a8ac-28e9-4043-aab2-65cc2a945b68" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b252335c-76f1-4bb6-bf6c-1ee4eabbd7ed]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:49 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40" returned: 0 in 0.302s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97f534c-ec60-48c3-af41-5f99f8f465d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:49 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 Aug 25 06:58:49 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b95f6c5-1a62-4665-8513-92ce13826e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Volume volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 (65adda74-aaa6-4958-9bb4-4d57b0d37a40): created successfully Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b95f6c5-1a62-4665-8513-92ce13826e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Flow 'volume_create_manager' (48da6288-3ebd-480d-adc3-18efb10ef2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f7d5a5d7-59e2-4b41-8cf6-7f972d961ee6 tempest-VolumesListTestJSON-258504541 None] Created volume successfully. Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd613fb-3176-4ed6-9e70-df7cb4457bb8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:49 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 Aug 25 06:58:49 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:49 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68" returned: 0 in 0.431s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:49 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68 Aug 25 06:58:49 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:50 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721" returned: 0 in 0.386s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 2G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:50 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b7a4a8ac-28e9-4043-aab2-65cc2a945b68" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-quobyte-b7a4a8ac-28e9-4043-aab2-65cc2a945b68" released by "delete_volume" :: held 0.728s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 2G" returned: 0 in 0.107s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.530s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-825c6634-c431-45bf-92ca-454ca4eb643a tempest-VolumesExtendTest-516392768 None] Extend volume completed successfully. Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Created reservations ['e6892b42-7a84-4b18-a6ba-d2bf3de41959', '92dc8c81-591a-4209-ab4c-7b725079e724', '60d44c0c-5ff0-420d-b8c9-c371aaacdd66', '373e985c-be7d-4a55-b197-d96c224b7ba4'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:50 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:50 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "cinder-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "cinder-quobyte-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:50 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Deleted volume successfully. Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-quobyte-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e15a648f-c03e-4bf1-9412-9d5244237012 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-b7a4a8ac-28e9-4043-aab2-65cc2a945b68-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2947e5bc-44ec-43fe-be1f-39597264d72b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:50 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 Aug 25 06:58:50 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-a89bc042-44cf-4758-9a36-5d6dde8de721-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Lock "cinder-a89bc042-44cf-4758-9a36-5d6dde8de721-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-quobyte-a89bc042-44cf-4758-9a36-5d6dde8de721" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:51 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39" returned: 0 in 0.518s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-a89bc042-44cf-4758-9a36-5d6dde8de721" acquired by "delete_volume" :: waited 0.037s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:51 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39 Aug 25 06:58:51 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2cfc8-df76-400e-bf98-01b391ff1a7b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:51 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 Aug 25 06:58:51 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:51 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39" returned: 0 in 0.287s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-quobyte-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39" released by "delete_volume" :: held 0.863s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Created reservations ['a67871fc-7ddb-493c-8fed-02a6833dd7a6', '706a1df0-1a4e-4a50-a7db-0ffee68747ad', '259b178f-33bf-4895-bebc-48c84362ffec', 'e15a2b8e-f838-4731-a817-903da91fb9eb'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:51 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:51 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:51 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721" returned: 0 in 0.540s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:51 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721 Aug 25 06:58:51 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:52 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.413s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Deleted volume successfully. Aug 25 06:58:52 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b39b82d9-db51-471c-8f89-e8d95b5c12c1 tempest-TestServerVolumeAttachmentScenario-1500397123 None] Lock "cinder-f7e5bd03-b10c-4b31-aea2-c6e8990a2d39-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a89bc042-44cf-4758-9a36-5d6dde8de721" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-a89bc042-44cf-4758-9a36-5d6dde8de721" released by "delete_volume" :: held 0.957s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Created reservations ['7bdf4260-b1ef-43da-b732-02cd4918c90a', '7fc3fb1c-9bed-4baf-a869-756bdc129c17', 'e2774b0e-6bd1-4e53-97dd-7cc483b15004', '3f517058-c78b-4372-a69a-3387ec282171'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:52 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:52 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:52 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.314s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Deleted volume successfully. Aug 25 06:58:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cb3099a0-5f84-43c2-879f-8dc24b38c280 tempest-VolumesExtendTest-516392768 None] Lock "cinder-a89bc042-44cf-4758-9a36-5d6dde8de721-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Acquiring lock "cinder-65adda74-aaa6-4958-9bb4-4d57b0d37a40-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Lock "cinder-65adda74-aaa6-4958-9bb4-4d57b0d37a40-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Acquiring lock "cinder-quobyte-65adda74-aaa6-4958-9bb4-4d57b0d37a40" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Lock "cinder-quobyte-65adda74-aaa6-4958-9bb4-4d57b0d37a40" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:53 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7d89dd-89cd-4274-9459-c09574eda5d6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 Aug 25 06:58:54 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Flow 'volume_create_manager' (08109cf5-d4c9-48b0-a0be-dcb46619d551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd40d58-4380-426c-879a-5ea88836f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd40d58-4380-426c-879a-5ea88836f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1681652121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b1227e-73a4-44a1-9934-e6da432b5f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e65d0bdb2bd4822899c233c877bfb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:54Z,use_quota=True,user_id='787ac8edae4940acbcb976a95c227593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588471ab-1b09-4f55-a4b1-7a368409397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588471ab-1b09-4f55-a4b1-7a368409397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b8b231-7c16-4aba-836d-e3b31aac196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b8b231-7c16-4aba-836d-e3b31aac196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b1227e-73a4-44a1-9934-e6da432b5f11', 'volume_name': 'volume-e3b1227e-73a4-44a1-9934-e6da432b5f11', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685ddff5-4e0e-4ded-9f63-2b08ed68b5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685ddff5-4e0e-4ded-9f63-2b08ed68b5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934b7424-dc33-4fe3-bcc3-f511735d5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:54 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Volume e3b1227e-73a4-44a1-9934-e6da432b5f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b1227e-73a4-44a1-9934-e6da432b5f11', 'volume_size': 1} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1681652121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b1227e-73a4-44a1-9934-e6da432b5f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e65d0bdb2bd4822899c233c877bfb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:58:54Z,use_quota=True,user_id='787ac8edae4940acbcb976a95c227593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Creating volume e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:58:54 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40" returned: 0 in 0.472s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 1073741824 Aug 25 06:58:54 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40 Aug 25 06:58:54 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-65adda74-aaa6-4958-9bb4-4d57b0d37a40" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Lock "cinder-quobyte-65adda74-aaa6-4958-9bb4-4d57b0d37a40" released by "delete_volume" :: held 0.811s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Created reservations ['3a42f06f-86df-4ae6-a621-14a6947f3a4a', '76234dfd-6b79-452d-a08d-3f89c1e520ab', '17255f6c-d6fd-4cec-90cc-5f2088e91810', '81d21f22-b2b6-477a-a167-8855ed7f6fd8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 1073741824" returned: 0 in 0.470s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:54 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:54 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:54 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 Aug 25 06:58:54 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "cinder-ec94daf4-664d-4c4d-a362-c637be1df965-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-ec94daf4-664d-4c4d-a362-c637be1df965-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:55 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.309s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Deleted volume successfully. Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-26ae232b-d651-4686-a440-83bd058f58ad tempest-VolumesListTestJSON-258504541 None] Lock "cinder-65adda74-aaa6-4958-9bb4-4d57b0d37a40-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "cinder-quobyte-ec94daf4-664d-4c4d-a362-c637be1df965" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-quobyte-ec94daf4-664d-4c4d-a362-c637be1df965" acquired by "delete_volume" :: waited 0.037s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:55 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6856276a-c68d-4519-9305-fc3dbed895a4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934b7424-dc33-4fe3-bcc3-f511735d5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b1227e-73a4-44a1-9934-e6da432b5f11', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7813c3-5fe0-4a7b-9789-07b5742fd88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:58:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Volume volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 (e3b1227e-73a4-44a1-9934-e6da432b5f11): created successfully Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7813c3-5fe0-4a7b-9789-07b5742fd88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Flow 'volume_create_manager' (08109cf5-d4c9-48b0-a0be-dcb46619d551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:58:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-75e90892-4e80-4fe6-aeb7-cfc86b4bfc61 tempest-VolumesExtendTest-516392768 None] Created volume successfully. Aug 25 06:58:55 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 Aug 25 06:58:55 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:55 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965" returned: 0 in 0.430s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:55 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965 Aug 25 06:58:55 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:56 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ec94daf4-664d-4c4d-a362-c637be1df965" returned: 0 in 0.258s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-quobyte-ec94daf4-664d-4c4d-a362-c637be1df965" released by "delete_volume" :: held 0.751s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Created reservations ['0ffb2840-6dae-498d-8bc2-9eb765add17c', '139b56ba-212d-4470-b2f6-68d231861e60', '6244bb37-4997-42dc-95ff-a7de3e2df44f', '0760d7eb-4e76-4e27-9894-97d0d56dae54'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:56 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:56 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "cinder-e206d301-d7eb-4bfe-aaa5-0139bc158ba2-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-e206d301-d7eb-4bfe-aaa5-0139bc158ba2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "cinder-quobyte-e206d301-d7eb-4bfe-aaa5-0139bc158ba2" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-quobyte-e206d301-d7eb-4bfe-aaa5-0139bc158ba2" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[26623812-4808-4ea9-922e-d2f9a063cc82]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:56 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.619s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Deleted volume successfully. Aug 25 06:58:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a72028b-96db-4490-929f-c6a059adc6d2 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-ec94daf4-664d-4c4d-a362-c637be1df965-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:56 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 Aug 25 06:58:56 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Creating offline snapshot 8af2a52e-c417-4a69-b54d-5413acc9a56d of volume e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f9e88-d2e3-4504-ab62-49cdc84a5b84]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 Aug 25 06:58:57 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2" returned: 0 in 0.597s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2 Aug 25 06:58:57 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11" returned: 0 in 0.586s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:57 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d 1G Aug 25 06:58:57 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:57 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e206d301-d7eb-4bfe-aaa5-0139bc158ba2" returned: 0 in 0.425s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-quobyte-e206d301-d7eb-4bfe-aaa5-0139bc158ba2" released by "delete_volume" :: held 1.098s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:57 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Created reservations ['ba17efb0-7961-4729-a0bd-f304a95fe43b', '4d4bcb9f-a74f-4fd2-9088-7cf5ebbcac69', 'fb85e177-883e-4372-8531-c000b60e7adc', 'd35dc961-4a6f-4ff0-82c1-003a08df1346'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:58 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:58:58 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:58 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d 1G" returned: 0 in 0.627s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:58 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d Aug 25 06:58:58 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:58 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:58:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Deleted volume successfully. Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fe74d78c-4e9c-4f58-9f4b-af42ded6a922 tempest-VolumesListTestJSON-258504541 None] Lock "cinder-e206d301-d7eb-4bfe-aaa5-0139bc158ba2-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:58:58 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:58 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d is being set with open permissions: ugo+rw Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:58 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d Aug 25 06:58:58 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:58 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:59 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info Aug 25 06:58:59 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:59 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:59 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info is being set with open permissions: ugo+rw Aug 25 06:58:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:58:59 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info Aug 25 06:58:59 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:58:59 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Aug 25 06:58:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.info" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:58:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:58:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6af3f47e-7550-44c7-834b-c55bf912c67e tempest-VolumesExtendTest-516392768 None] Create snapshot completed successfully Aug 25 06:59:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d807ee85-6cce-407d-903b-5c0d8e155144]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:00 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 Aug 25 06:59:00 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:00 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11" returned: 0 in 0.508s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d 2G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d 2G" returned: 0 in 0.171s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.720s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f1286c2d-8c03-45b8-9064-ea170a01a0df tempest-VolumesExtendTest-516392768 None] Extend volume completed successfully. Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-8af2a52e-c417-4a69-b54d-5413acc9a56d-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Lock "cinder-8af2a52e-c417-4a69-b54d-5413acc9a56d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-quobyte-e3b1227e-73a4-44a1-9934-e6da432b5f11" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-e3b1227e-73a4-44a1-9934-e6da432b5f11" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-quobyte-8af2a52e-c417-4a69-b54d-5413acc9a56d" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-8af2a52e-c417-4a69-b54d-5413acc9a56d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Deleting offline snapshot 8af2a52e-c417-4a69-b54d-5413acc9a56d of volume e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] snapshot_file for this snap is: volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4bfac6-a03b-419d-adaf-308a9b137745]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:01 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d Aug 25 06:59:01 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:02 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d" returned: 0 in 0.465s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3b1227e-73a4-44a1-9934-e6da432b5f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[945dafad-7c05-4a4e-9246-d61f512d1dcb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-51df0033-d83c-4e0f-b01b-ac173d8d548d req-d6459b80-5fee-49f1-aa77-cf7aadeca9ca tempest-AttachVolumeNegativeTest-634367111 None] Terminate volume connection completed successfully. Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-51df0033-d83c-4e0f-b01b-ac173d8d548d req-d6459b80-5fee-49f1-aa77-cf7aadeca9ca tempest-AttachVolumeNegativeTest-634367111 None] Deleting attachment c60ed19b-2489-4ba2-bde9-bafe98288a09. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 06:59:02 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 Aug 25 06:59:02 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:02 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11" returned: 0 in 0.450s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:02 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d Aug 25 06:59:02 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Flow 'volume_create_manager' (c93bbcd3-0032-420f-9a47-1c158d550be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7e6603-c153-4feb-af69-a28a6f7d7f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7e6603-c153-4feb-af69-a28a6f7d7f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-926842698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f275d65f-05bb-47fc-92c0-cacb41ace54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bfc12bcfcb47c69a019161b66d5fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:03Z,use_quota=True,user_id='15aff1f7e5f24247bd8c5af7144d18f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b173d2d9-bac3-4781-8b4d-09de1f4ce502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b173d2d9-bac3-4781-8b4d-09de1f4ce502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b99f3b7-4baf-40b7-a9ec-9ece140b416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b99f3b7-4baf-40b7-a9ec-9ece140b416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f275d65f-05bb-47fc-92c0-cacb41ace54e', 'volume_name': 'volume-f275d65f-05bb-47fc-92c0-cacb41ace54e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b25654-d252-4d74-a23b-1a7bbc7da9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b25654-d252-4d74-a23b-1a7bbc7da9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd5e2c7-b818-4fbb-ba64-29010e01fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Volume f275d65f-05bb-47fc-92c0-cacb41ace54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f275d65f-05bb-47fc-92c0-cacb41ace54e', 'volume_size': 1} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-926842698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f275d65f-05bb-47fc-92c0-cacb41ace54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bfc12bcfcb47c69a019161b66d5fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:03Z,use_quota=True,user_id='15aff1f7e5f24247bd8c5af7144d18f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Creating volume f275d65f-05bb-47fc-92c0-cacb41ace54e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:02 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:03 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e 1073741824 Aug 25 06:59:03 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:03 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d" returned: 0 in 0.596s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:03 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d Aug 25 06:59:03 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:03 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e 1073741824" returned: 0 in 0.679s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:03 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11.8af2a52e-c417-4a69-b54d-5413acc9a56d" returned: 0 in 0.409s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:03 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e Aug 25 06:59:03 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-8af2a52e-c417-4a69-b54d-5413acc9a56d" released by "_delete_snapshot" :: held 2.184s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-e3b1227e-73a4-44a1-9934-e6da432b5f11" released by "delete_snapshot" :: held 2.241s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Created reservations ['87b8f314-7aee-4136-a681-275efcefe6ac', 'f47aacf5-d68e-4263-b505-a52d8d4aa5fe', '45cfc26d-4710-4719-a72c-88822d541c6f', 'ef3c3912-8144-4cd5-9137-ac78a4787c2b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Delete snapshot completed successfully. Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69336bf0-0e33-4d31-8807-cc3ef267633e tempest-VolumesExtendTest-516392768 None] Lock "cinder-8af2a52e-c417-4a69-b54d-5413acc9a56d-delete_snapshot" released by "delete_snapshot" :: held 2.552s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:04 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e" returned: 0 in 0.526s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd5e2c7-b818-4fbb-ba64-29010e01fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f275d65f-05bb-47fc-92c0-cacb41ace54e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d67e078-c1c8-4b47-834e-eab474b8afe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Volume volume-f275d65f-05bb-47fc-92c0-cacb41ace54e (f275d65f-05bb-47fc-92c0-cacb41ace54e): created successfully Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d67e078-c1c8-4b47-834e-eab474b8afe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Flow 'volume_create_manager' (c93bbcd3-0032-420f-9a47-1c158d550be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-96357ca2-a4da-494a-803a-855c5ecc4a4c tempest-VolumesNegativeTest-1434207729 None] Created volume successfully. Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-e3b1227e-73a4-44a1-9934-e6da432b5f11-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Lock "cinder-e3b1227e-73a4-44a1-9934-e6da432b5f11-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Acquiring lock "cinder-quobyte-e3b1227e-73a4-44a1-9934-e6da432b5f11" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-e3b1227e-73a4-44a1-9934-e6da432b5f11" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0857bb72-d894-4ef9-8646-c031ba178df4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:05 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 Aug 25 06:59:05 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:05 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11" returned: 0 in 0.533s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:05 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11 Aug 25 06:59:05 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:06 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3b1227e-73a4-44a1-9934-e6da432b5f11" returned: 0 in 0.463s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Lock "cinder-quobyte-e3b1227e-73a4-44a1-9934-e6da432b5f11" released by "delete_volume" :: held 1.096s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Created reservations ['1a2c0371-0775-4470-b5f7-1b78d82ea9df', '64ab32ad-a88a-41f6-a98c-196cb91ccd3b', '4d73f1f1-5cd0-4ab2-8aa9-45aac0d0965b', 'f144ee01-5db2-40c4-9b1e-2f34a09f6678'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:06 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:06 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:06 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.375s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:06 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Deleted volume successfully. Aug 25 06:59:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0a3d9b1-d482-4d10-856d-524baeee7ef1 tempest-VolumesExtendTest-516392768 None] Lock "cinder-e3b1227e-73a4-44a1-9934-e6da432b5f11-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (03aafc15-b33c-4589-869e-d6f70cdf75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6c3bc-ad10-44d0-bdfc-2394b2f36d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6c3bc-ad10-44d0-bdfc-2394b2f36d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-620678859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf8a0d6-b526-4b17-b81c-2ea45dee1126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:10Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a7d0cf-af1a-4d61-8ac0-72da083049f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a7d0cf-af1a-4d61-8ac0-72da083049f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65896b67-1ccd-4397-9732-e14d45595328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65896b67-1ccd-4397-9732-e14d45595328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf8a0d6-b526-4b17-b81c-2ea45dee1126', 'volume_name': 'volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21966cc1-05b1-4ed3-927d-00984228d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21966cc1-05b1-4ed3-927d-00984228d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a819e93d-25b1-4ad5-ba79-a6282efd5417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:10 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume ddf8a0d6-b526-4b17-b81c-2ea45dee1126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126', 'volume_size': 1} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-620678859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf8a0d6-b526-4b17-b81c-2ea45dee1126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:10Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating volume ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:10 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:10 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 1073741824 Aug 25 06:59:10 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:10 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 1073741824" returned: 0 in 0.566s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:10 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 Aug 25 06:59:10 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:11 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a819e93d-25b1-4ad5-ba79-a6282efd5417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93b401f-5690-4d6b-9a79-d128c5bdf8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 (ddf8a0d6-b526-4b17-b81c-2ea45dee1126): created successfully Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93b401f-5690-4d6b-9a79-d128c5bdf8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (03aafc15-b33c-4589-869e-d6f70cdf75f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d6839a45-dcb1-472d-8496-32506691bebe tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created volume successfully. Aug 25 06:59:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating offline snapshot 98a83d5d-2cb8-4fee-a7e1-8edcc664f197 of volume ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:59:12 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2594f060-7a96-4e8a-a55a-34888ab01e48]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:12 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 Aug 25 06:59:12 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:13 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" returned: 0 in 0.710s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:13 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 1G Aug 25 06:59:13 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:13 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 1G" returned: 0 in 0.667s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:13 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 Aug 25 06:59:13 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:14 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197" returned: 0 in 0.493s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:14 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 is being set with open permissions: ugo+rw Aug 25 06:59:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:14 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 Aug 25 06:59:14 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:14 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197" returned: 0 in 0.555s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:15 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info Aug 25 06:59:15 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:15 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info" returned: 0 in 0.424s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:15 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info is being set with open permissions: ugo+rw Aug 25 06:59:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:15 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info Aug 25 06:59:15 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:15 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.info" returned: 0 in 0.442s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.536s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-80578e72-d2dd-4e9d-8ecc-db68c3b6f0bf tempest-CreateVolumesFromSnapshotTest-1058584658 None] Create snapshot completed successfully Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (4a90db40-bdfb-48f3-9afb-5c0d1f5f4194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33513de5-ead8-47d8-9dba-9e9fac88568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33513de5-ead8-47d8-9dba-9e9fac88568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526146534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d66d909-a55c-4e8c-b38f-34465aba268f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:18Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50fa352-840a-450d-8500-bfe8c0694134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50fa352-840a-450d-8500-bfe8c0694134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c3dab6-8458-4f70-8961-40624a1745bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c3dab6-8458-4f70-8961-40624a1745bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d66d909-a55c-4e8c-b38f-34465aba268f', 'volume_name': 'volume-2d66d909-a55c-4e8c-b38f-34465aba268f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c087549-9032-4c85-af77-67f0b61717d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c087549-9032-4c85-af77-67f0b61717d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c443184-43b0-422e-bf3a-402a7d8223ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:17 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume 2d66d909-a55c-4e8c-b38f-34465aba268f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d66d909-a55c-4e8c-b38f-34465aba268f', 'volume_size': 1} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526146534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d66d909-a55c-4e8c-b38f-34465aba268f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:18Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating volume 2d66d909-a55c-4e8c-b38f-34465aba268f {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:17 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:17 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f 1073741824 Aug 25 06:59:17 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (0e842a9e-6dd0-4f08-b2ae-7b0a689eddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d42157-7efe-4293-94a5-61fc54f406cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d42157-7efe-4293-94a5-61fc54f406cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-73837636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e03193-9111-4921-9754-6a46bf8a8fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:18Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5a8157-a02e-4751-b296-10dd08567d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5a8157-a02e-4751-b296-10dd08567d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea78e1f-d433-48c4-99bc-2571d6a1458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea78e1f-d433-48c4-99bc-2571d6a1458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e03193-9111-4921-9754-6a46bf8a8fa1', 'volume_name': 'volume-96e03193-9111-4921-9754-6a46bf8a8fa1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55b8a9d-9f64-47e3-89d5-be194431f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55b8a9d-9f64-47e3-89d5-be194431f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704cc815-1367-41f8-a64c-37b8675d30f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume 96e03193-9111-4921-9754-6a46bf8a8fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e03193-9111-4921-9754-6a46bf8a8fa1', 'volume_size': 1} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:18 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f 1073741824" returned: 0 in 0.872s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:18 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f Aug 25 06:59:18 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:19 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (bb1cf111-d993-4e24-b29a-9a17c92bf199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a925b3ad-a566-41ef-ae0d-1bcc2e69c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f" returned: 0 in 0.527s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-73837636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e03193-9111-4921-9754-6a46bf8a8fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:18Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating volume 96e03193-9111-4921-9754-6a46bf8a8fa1 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:19 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a925b3ad-a566-41ef-ae0d-1bcc2e69c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444854010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafee763-ec4c-47ed-88f8-32bbeca928e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:19Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1825db36-eff4-4fff-bd72-475b7263f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1825db36-eff4-4fff-bd72-475b7263f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 1073741824 Aug 25 06:59:19 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0016d356-0cbf-4989-a894-c9aecff5bee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0016d356-0cbf-4989-a894-c9aecff5bee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafee763-ec4c-47ed-88f8-32bbeca928e6', 'volume_name': 'volume-aafee763-ec4c-47ed-88f8-32bbeca928e6', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12221140-3748-4549-846c-df69987e1735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12221140-3748-4549-846c-df69987e1735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ece5ed-772b-46ed-8cef-b2062163b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume aafee763-ec4c-47ed-88f8-32bbeca928e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafee763-ec4c-47ed-88f8-32bbeca928e6', 'volume_size': 1} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c443184-43b0-422e-bf3a-402a7d8223ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d66d909-a55c-4e8c-b38f-34465aba268f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e442a5-18cc-4172-8847-5b1e792531a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume volume-2d66d909-a55c-4e8c-b38f-34465aba268f (2d66d909-a55c-4e8c-b38f-34465aba268f): created successfully Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e442a5-18cc-4172-8847-5b1e792531a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (4a90db40-bdfb-48f3-9afb-5c0d1f5f4194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-72cd05f0-e1cd-4494-8338-731c854091f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created volume successfully. Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (cdc921a2-249c-4b72-87f1-6a84dd7300f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d156c4-c6a0-4f61-820c-79b1e4f58547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d156c4-c6a0-4f61-820c-79b1e4f58547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358640285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556caeb7-017e-432e-8ea0-efddfbbb529c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:20Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489259fe-ba3d-48ef-8e9b-727d94b29fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489259fe-ba3d-48ef-8e9b-727d94b29fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e52396a-2268-4518-8330-efe7db78ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e52396a-2268-4518-8330-efe7db78ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556caeb7-017e-432e-8ea0-efddfbbb529c', 'volume_name': 'volume-556caeb7-017e-432e-8ea0-efddfbbb529c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53732f15-cb0e-4bd6-89a3-04c6c605f945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53732f15-cb0e-4bd6-89a3-04c6c605f945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c3fa67-a4f3-42f5-be06-35841de09785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume 556caeb7-017e-432e-8ea0-efddfbbb529c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556caeb7-017e-432e-8ea0-efddfbbb529c', 'volume_size': 1} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 1073741824" returned: 0 in 0.880s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:20 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 Aug 25 06:59:20 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (66a538c4-2e4c-4b07-9961-6a7d0b8d29ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b806d2-0438-4f2a-af48-569b758ecf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b806d2-0438-4f2a-af48-569b758ecf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408800608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ca09cf-a0c3-4d54-9e10-4daa9170cc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:20Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55243fba-9f07-47b4-9db9-e371ec36893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55243fba-9f07-47b4-9db9-e371ec36893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d53a3c-4f05-4074-8da4-ad6af2cd33bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d53a3c-4f05-4074-8da4-ad6af2cd33bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ca09cf-a0c3-4d54-9e10-4daa9170cc5d', 'volume_name': 'volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9363bfce-636b-48f2-83fb-27074985af78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9363bfce-636b-48f2-83fb-27074985af78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d204142-944a-4f33-9ea3-1f2cfc7b7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume 84ca09cf-a0c3-4d54-9e10-4daa9170cc5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d', 'volume_size': 1} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:20 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.169s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444854010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafee763-ec4c-47ed-88f8-32bbeca928e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:19Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating volume aafee763-ec4c-47ed-88f8-32bbeca928e6 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:20 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704cc815-1367-41f8-a64c-37b8675d30f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e03193-9111-4921-9754-6a46bf8a8fa1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f4c5a7-57ee-48d0-8dad-e870859b5333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:20 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 1073741824 Aug 25 06:59:20 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:20 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume volume-96e03193-9111-4921-9754-6a46bf8a8fa1 (96e03193-9111-4921-9754-6a46bf8a8fa1): created successfully Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f4c5a7-57ee-48d0-8dad-e870859b5333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (0e842a9e-6dd0-4f08-b2ae-7b0a689eddab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:20 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-88d9c175-b238-4590-b5a1-3567b6a79f20 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created volume successfully. Aug 25 06:59:21 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 1073741824" returned: 0 in 0.768s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:21 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 Aug 25 06:59:21 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:21 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6" returned: 0 in 0.360s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-358640285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556caeb7-017e-432e-8ea0-efddfbbb529c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:20Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating volume 556caeb7-017e-432e-8ea0-efddfbbb529c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:21 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ece5ed-772b-46ed-8cef-b2062163b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafee763-ec4c-47ed-88f8-32bbeca928e6', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd3016-3025-4d93-8b6c-d46f93b18b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:21 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c 1073741824 Aug 25 06:59:21 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 (aafee763-ec4c-47ed-88f8-32bbeca928e6): created successfully Aug 25 06:59:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd3016-3025-4d93-8b6c-d46f93b18b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (bb1cf111-d993-4e24-b29a-9a17c92bf199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-28e23ede-e573-4750-b370-4e416b1c4c1c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created volume successfully. Aug 25 06:59:23 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c 1073741824" returned: 0 in 1.082s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:23 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c Aug 25 06:59:23 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:23 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c" returned: 0 in 0.436s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408800608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ca09cf-a0c3-4d54-9e10-4daa9170cc5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c2674c08184a2fb2afe2530f427477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:20Z,use_quota=True,user_id='9961e5f927064664919d276454297753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Creating volume 84ca09cf-a0c3-4d54-9e10-4daa9170cc5d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:23 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c3fa67-a4f3-42f5-be06-35841de09785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556caeb7-017e-432e-8ea0-efddfbbb529c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:23 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d 1073741824 Aug 25 06:59:23 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e33b55-bb2f-4dfc-a6f8-f5adfd4f53fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:23 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume volume-556caeb7-017e-432e-8ea0-efddfbbb529c (556caeb7-017e-432e-8ea0-efddfbbb529c): created successfully Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e33b55-bb2f-4dfc-a6f8-f5adfd4f53fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (cdc921a2-249c-4b72-87f1-6a84dd7300f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1773697d-9f46-40e1-a65a-de1d73ad715e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created volume successfully. Aug 25 06:59:24 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d 1073741824" returned: 0 in 0.851s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:24 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d Aug 25 06:59:24 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:24 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d" returned: 0 in 0.334s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d204142-944a-4f33-9ea3-1f2cfc7b7893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe27671-da7c-4d99-831b-b2e8f2b697f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:24 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Volume volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d (84ca09cf-a0c3-4d54-9e10-4daa9170cc5d): created successfully Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe27671-da7c-4d99-831b-b2e8f2b697f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Flow 'volume_create_manager' (66a538c4-2e4c-4b07-9961-6a7d0b8d29ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fcf9beab-9320-4c45-9e87-9b39c2c73028 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created volume successfully. Aug 25 06:59:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a649528-3d9b-4144-8485-406c508884db]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:25 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d Aug 25 06:59:25 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:26 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d" returned: 0 in 0.663s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:26 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d Aug 25 06:59:26 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:26 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d" returned: 0 in 0.565s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d" released by "delete_volume" :: held 1.349s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:26 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['1d1d0fa5-258f-492d-817c-37c77d796600', '00fe9fef-072e-4910-9663-5cc2727bb84d', '1e8d477f-156e-4413-8714-260bb811de2c', '86a987d3-6579-4353-afb7-030589d9077f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:27 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:27 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:27 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.431s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleted volume successfully. Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-556caeb7-017e-432e-8ea0-efddfbbb529c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2b9eb36b-d46d-4e50-a9b6-c7d8e94ea3f8 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-84ca09cf-a0c3-4d54-9e10-4daa9170cc5d-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-556caeb7-017e-432e-8ea0-efddfbbb529c-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-556caeb7-017e-432e-8ea0-efddfbbb529c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-556caeb7-017e-432e-8ea0-efddfbbb529c" acquired by "delete_volume" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53b529-df99-4407-a138-1de1f972a31a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:28 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c Aug 25 06:59:28 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:28 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c" returned: 0 in 0.707s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:28 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c Aug 25 06:59:28 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:29 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-556caeb7-017e-432e-8ea0-efddfbbb529c" returned: 0 in 0.587s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-556caeb7-017e-432e-8ea0-efddfbbb529c" released by "delete_volume" :: held 1.379s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['cf0ba7a8-5551-4de5-91ff-bab8823b9f16', '88081c7a-39c7-4783-b606-378894912fc7', '9f7b30f2-66b2-49a9-a082-ac9f32ccca2e', '9bedb31c-4b0a-46a0-9e70-d1cdc6b169e3'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:29 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:29 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:30 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.476s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleted volume successfully. Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fbacc3e-3b1d-4a85-8d63-cb7df34e33c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-556caeb7-017e-432e-8ea0-efddfbbb529c-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-aafee763-ec4c-47ed-88f8-32bbeca928e6-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-aafee763-ec4c-47ed-88f8-32bbeca928e6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-aafee763-ec4c-47ed-88f8-32bbeca928e6" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-aafee763-ec4c-47ed-88f8-32bbeca928e6" acquired by "delete_volume" :: waited 0.043s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1bc8c9-7983-4567-82fe-fd8ca07bd6e0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:30 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 Aug 25 06:59:30 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:31 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6" returned: 0 in 1.007s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:31 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6 Aug 25 06:59:31 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:31 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:31 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:32 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-aafee763-ec4c-47ed-88f8-32bbeca928e6" returned: 0 in 0.604s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-aafee763-ec4c-47ed-88f8-32bbeca928e6" released by "delete_volume" :: held 1.722s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:32 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.464s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['74adc640-0dcc-4269-b515-fdc6498f27d0', '4445bd5e-1755-41ed-ac54-d2bd5077a0ee', 'f0ed40f0-ef46-4953-9d71-f5c7750f6670', 'cfd0053f-275c-479a-aaf7-8589bfe97ef2'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:32 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:32 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-96e03193-9111-4921-9754-6a46bf8a8fa1-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-96e03193-9111-4921-9754-6a46bf8a8fa1-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-96e03193-9111-4921-9754-6a46bf8a8fa1" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-96e03193-9111-4921-9754-6a46bf8a8fa1" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:32 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.558s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:33 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleted volume successfully. Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[85373019-5fe8-4140-ba90-0e421a5161ab]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0a31a888-8b08-4884-8b3a-80aa4d8e09c6 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-aafee763-ec4c-47ed-88f8-32bbeca928e6-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:33 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 Aug 25 06:59:33 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:33 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1" returned: 0 in 0.558s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:33 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1 Aug 25 06:59:33 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-96e03193-9111-4921-9754-6a46bf8a8fa1" returned: 0 in 0.433s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-96e03193-9111-4921-9754-6a46bf8a8fa1" released by "delete_volume" :: held 1.059s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['4757305d-c881-4530-871c-88d83a28d0dd', '82279d7c-2b71-47a7-b70d-d886948451ae', 'cbf33416-155e-4315-9be2-7e713f74d768', 'd9606f8e-c310-4864-b276-9c18bb63cc3f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:34 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:34 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:34 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.484s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleted volume successfully. Aug 25 06:59:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3d8cc559-5396-4734-9b89-b2a81c83622e tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-96e03193-9111-4921-9754-6a46bf8a8fa1-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-2d66d909-a55c-4e8c-b38f-34465aba268f-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-2d66d909-a55c-4e8c-b38f-34465aba268f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-2d66d909-a55c-4e8c-b38f-34465aba268f" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-2d66d909-a55c-4e8c-b38f-34465aba268f" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:35 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d50b91-e7ed-4c72-b686-223bf1045c33]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:35 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f Aug 25 06:59:35 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f" returned: 0 in 0.731s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Acquiring lock "cinder-f275d65f-05bb-47fc-92c0-cacb41ace54e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:36 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f Aug 25 06:59:36 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Lock "cinder-f275d65f-05bb-47fc-92c0-cacb41ace54e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Acquiring lock "cinder-quobyte-f275d65f-05bb-47fc-92c0-cacb41ace54e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Lock "cinder-quobyte-f275d65f-05bb-47fc-92c0-cacb41ace54e" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deff660-8213-40fb-9466-b07281d31908]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:36 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d66d909-a55c-4e8c-b38f-34465aba268f" returned: 0 in 0.385s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:36 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e Aug 25 06:59:36 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-2d66d909-a55c-4e8c-b38f-34465aba268f" released by "delete_volume" :: held 1.183s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['a0929196-ac92-4539-8a15-63f01f1acc97', '81cedb77-da33-43d0-af3c-065e7c6abac8', '2e697243-7337-413a-8490-eaf4280d1d58', '7d0e1373-fba8-42d5-bc37-6139c36fc34f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:36 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:36 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e" returned: 0 in 0.525s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:36 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e Aug 25 06:59:36 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:36 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.326s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:36 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleted volume successfully. Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1d6175f8-7580-439d-afc0-d9427098243c tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-2d66d909-a55c-4e8c-b38f-34465aba268f-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:37 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f275d65f-05bb-47fc-92c0-cacb41ace54e" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Lock "cinder-quobyte-f275d65f-05bb-47fc-92c0-cacb41ace54e" released by "delete_volume" :: held 0.902s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Created reservations ['276460e5-7f65-4bcf-b0c5-bee13d269567', '8f3bba3b-f336-40a7-bd0f-89f23b6bc1e5', '16aa721c-23a4-4d75-b51d-7362ed8553de', '1613500f-1a04-43e5-81da-5ba534752f84'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:37 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:37 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-98a83d5d-2cb8-4fee-a7e1-8edcc664f197-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-98a83d5d-2cb8-4fee-a7e1-8edcc664f197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-98a83d5d-2cb8-4fee-a7e1-8edcc664f197" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-98a83d5d-2cb8-4fee-a7e1-8edcc664f197" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleting offline snapshot 98a83d5d-2cb8-4fee-a7e1-8edcc664f197 of volume ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] snapshot_file for this snap is: volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5652cbc1-138b-4577-84a5-76e41950dbd3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:37 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:37 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 Aug 25 06:59:37 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Deleted volume successfully. Aug 25 06:59:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a3c8a154-f0a9-4bd3-9d7b-91f887fb45a1 tempest-VolumesNegativeTest-1434207729 None] Lock "cinder-f275d65f-05bb-47fc-92c0-cacb41ace54e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:38 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197" returned: 0 in 0.462s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae815acd-9904-4be9-9a61-6fbfeb9e1d93]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:38 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 Aug 25 06:59:38 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:38 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" returned: 0 in 0.428s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:38 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 Aug 25 06:59:38 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:39 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:39 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197 Aug 25 06:59:39 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:39 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126.98a83d5d-2cb8-4fee-a7e1-8edcc664f197" returned: 0 in 0.259s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=131,cinder:UPDATE=148,cinder:INSERT=41,cinder:DELETE=13 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=113,cinder:UPDATE=166,cinder:INSERT=42,cinder:DELETE=14 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-98a83d5d-2cb8-4fee-a7e1-8edcc664f197" released by "_delete_snapshot" :: held 1.762s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" released by "delete_snapshot" :: held 1.793s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['4336b63d-3d3d-462e-b737-e9717ae69403', '172ec5ad-bb9f-4f22-94f8-87777ee841c3', '628b1915-2682-4934-b74a-8c16d9d984ea', 'eb70c531-910e-43a3-9321-1de22d6a279d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Delete snapshot completed successfully. Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f990f53f-9803-40f0-befa-d8e7a5d0d6dc tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-98a83d5d-2cb8-4fee-a7e1-8edcc664f197-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-ddf8a0d6-b526-4b17-b81c-2ea45dee1126-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-ddf8a0d6-b526-4b17-b81c-2ea45dee1126-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "cinder-quobyte-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02f3c6-1152-45e2-8b35-8d0bbb90be4b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:39 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 Aug 25 06:59:39 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:40 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" returned: 0 in 0.414s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:40 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126 Aug 25 06:59:40 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:40 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" returned: 0 in 0.293s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-quobyte-ddf8a0d6-b526-4b17-b81c-2ea45dee1126" released by "delete_volume" :: held 0.789s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Created reservations ['f4f40cd1-eadf-4f4e-a22f-71cfff31b703', '9bc53791-d5a5-4b8a-97b5-1ea470388456', '062e5f95-7eaf-4165-869e-3fe2e77024aa', '526028e6-0ecf-41d3-bfcc-3bd3bba2ffa0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:40 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:40 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:41 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.484s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Deleted volume successfully. Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-588496b3-e62c-4323-8294-065bc7dec671 tempest-CreateVolumesFromSnapshotTest-1058584658 None] Lock "cinder-ddf8a0d6-b526-4b17-b81c-2ea45dee1126-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Flow 'volume_create_manager' (a87e6f68-e4dd-433e-855f-6bf2d23b1918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32207e7d-86f1-4b6f-80b5-bd82c1a2e201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32207e7d-86f1-4b6f-80b5-bd82c1a2e201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-197374775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a31ce8-8bc9-473c-9ec6-08ebd5e38c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb14a0520ed47dd856ef3cd54f6828d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:42Z,use_quota=True,user_id='31f6263ed46c453d85a70f2a1b510fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9762c11e-a8fb-424b-ae3e-c28cf98ddf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9762c11e-a8fb-424b-ae3e-c28cf98ddf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3c4306-32b6-4a05-8292-546fa69f9969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3c4306-32b6-4a05-8292-546fa69f9969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a31ce8-8bc9-473c-9ec6-08ebd5e38c59', 'volume_name': 'volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59', 'volume_size': 2}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb076129-9341-4dbd-9638-451388686150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb076129-9341-4dbd-9638-451388686150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d955478-6b19-40ae-9081-90c47850e733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Volume 84a31ce8-8bc9-473c-9ec6-08ebd5e38c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59', 'volume_size': 2} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-197374775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a31ce8-8bc9-473c-9ec6-08ebd5e38c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb14a0520ed47dd856ef3cd54f6828d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:42Z,use_quota=True,user_id='31f6263ed46c453d85a70f2a1b510fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Creating volume 84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:41 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 2147483648 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:41 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 2147483648 Aug 25 06:59:41 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:42 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 2147483648" returned: 0 in 0.611s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:42 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 Aug 25 06:59:42 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:42 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" returned: 0 in 0.329s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d955478-6b19-40ae-9081-90c47850e733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59', 'volume_size': 2}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b2f91b-ad07-4725-a920-c7a3e174fbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:43 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Volume volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 (84a31ce8-8bc9-473c-9ec6-08ebd5e38c59): created successfully Aug 25 06:59:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b2f91b-ad07-4725-a920-c7a3e174fbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Flow 'volume_create_manager' (a87e6f68-e4dd-433e-855f-6bf2d23b1918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e26da898-0ec1-4b6f-bc48-3aecb369e967 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Created volume successfully. Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Creating offline snapshot 8f7dd7a3-c71a-460a-b5be-cb7920aaa73c of volume 84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec13a56b-c6c4-446f-b457-a838b8b53a75]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:44 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 Aug 25 06:59:44 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:44 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" returned: 0 in 0.585s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c 2G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:44 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c 2G Aug 25 06:59:44 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:45 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c 2G" returned: 0 in 0.706s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:45 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c Aug 25 06:59:45 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" returned: 0 in 0.565s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:46 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c is being set with open permissions: ugo+rw Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:46 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c Aug 25 06:59:46 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Flow 'volume_create_manager' (24acc66c-4840-48c2-ad6f-5638276e9b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44133b85-1876-4e3b-a88b-550e5bf61bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44133b85-1876-4e3b-a88b-550e5bf61bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770020359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5075d67f-b9df-4b20-95ba-c60e1b27d634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7395dc96a8f4055a81f2d5c3b9728d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:46Z,use_quota=True,user_id='e01298140c62493789be0f74f9b2fd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc78272b-041d-4238-8c40-ff6d1cf5ecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc78272b-041d-4238-8c40-ff6d1cf5ecf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f99da40-1abf-4ed2-8c2f-9fe88da198b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f99da40-1abf-4ed2-8c2f-9fe88da198b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5075d67f-b9df-4b20-95ba-c60e1b27d634', 'volume_name': 'volume-5075d67f-b9df-4b20-95ba-c60e1b27d634', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9090ee-e650-4d3a-b354-ada7f4f211ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9090ee-e650-4d3a-b354-ada7f4f211ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f3fb5b-0e64-408f-8ec2-49890d515960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Volume 5075d67f-b9df-4b20-95ba-c60e1b27d634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5075d67f-b9df-4b20-95ba-c60e1b27d634', 'volume_size': 1} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:46 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" returned: 0 in 0.306s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:46 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info Aug 25 06:59:46 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info" returned: 0 in 0.303s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:46 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info is being set with open permissions: ugo+rw Aug 25 06:59:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:46 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info Aug 25 06:59:46 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:46 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.info" returned: 0 in 0.259s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770020359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5075d67f-b9df-4b20-95ba-c60e1b27d634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7395dc96a8f4055a81f2d5c3b9728d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:46Z,use_quota=True,user_id='e01298140c62493789be0f74f9b2fd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Creating volume 5075d67f-b9df-4b20-95ba-c60e1b27d634 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:47 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:47 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 1073741824 Aug 25 06:59:47 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eacc518e-c3f7-4028-8fbe-b7aa435eb108 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Create snapshot completed successfully Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "cinder-8f7dd7a3-c71a-460a-b5be-cb7920aaa73c-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-8f7dd7a3-c71a-460a-b5be-cb7920aaa73c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "cinder-quobyte-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-quobyte-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "cinder-quobyte-8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-quobyte-8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Deleting offline snapshot 8f7dd7a3-c71a-460a-b5be-cb7920aaa73c of volume 84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 06:59:47 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] snapshot_file for this snap is: volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 1073741824" returned: 0 in 0.622s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[785ff12d-1c2b-48d2-b0d8-49bbe7269b5f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:47 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 Aug 25 06:59:47 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:47 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c Aug 25 06:59:47 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:48 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634" returned: 0 in 0.309s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f3fb5b-0e64-408f-8ec2-49890d515960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5075d67f-b9df-4b20-95ba-c60e1b27d634', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b64cfe4-e358-4fce-88fd-49caa547e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:48 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Volume volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 (5075d67f-b9df-4b20-95ba-c60e1b27d634): created successfully Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b64cfe4-e358-4fce-88fd-49caa547e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Flow 'volume_create_manager' (24acc66c-4840-48c2-ad6f-5638276e9b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3712192a-812f-49bb-9b28-0a5f154ee14a tempest-ProjectReaderTests-1042747083 None] Created volume successfully. Aug 25 06:59:48 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" returned: 0 in 0.493s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbe2489-daf2-460e-a0be-bb70dfa5f7c2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:48 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 Aug 25 06:59:48 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:48 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" returned: 0 in 0.364s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:48 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c Aug 25 06:59:48 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:48 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:48 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c Aug 25 06:59:48 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:49 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59.8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" returned: 0 in 0.266s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-quobyte-8f7dd7a3-c71a-460a-b5be-cb7920aaa73c" released by "_delete_snapshot" :: held 1.613s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-quobyte-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" released by "delete_snapshot" :: held 1.642s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Created reservations ['72f812b0-30b6-45de-ac60-1005fcfc124b', '01982ac5-36a8-4a52-b0b8-1271759700cc', 'bf19a4e2-244a-4bdd-85bf-3bdaf3ca83bc', 'b8792bf5-25c1-43cc-826a-498f78d082cf'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Delete snapshot completed successfully. Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-94c526c0-8f94-4664-9f87-4bf6969d49da tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-8f7dd7a3-c71a-460a-b5be-cb7920aaa73c-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "cinder-5075d67f-b9df-4b20-95ba-c60e1b27d634-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-5075d67f-b9df-4b20-95ba-c60e1b27d634-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "cinder-quobyte-5075d67f-b9df-4b20-95ba-c60e1b27d634" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-quobyte-5075d67f-b9df-4b20-95ba-c60e1b27d634" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa477ef-3d48-40a4-b08b-5ce2491f1dfb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:49 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 Aug 25 06:59:49 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "cinder-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "cinder-quobyte-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-quobyte-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c651bb3-d064-4113-b7b2-1875a817400c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:49 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634" returned: 0 in 0.412s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:50 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634 Aug 25 06:59:50 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:50 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 Aug 25 06:59:50 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:50 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5075d67f-b9df-4b20-95ba-c60e1b27d634" returned: 0 in 0.277s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-quobyte-5075d67f-b9df-4b20-95ba-c60e1b27d634" released by "delete_volume" :: held 0.735s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Created reservations ['63d9a9fa-7641-4399-9ad8-71f3f52520c2', '5f27c004-1937-465b-9f9f-57e78b95b1d4', 'db0e3bf0-9933-43c0-b196-7f4b0dc16e4b', '790de7e7-62ad-48b6-8471-a0413e049834'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:50 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" returned: 0 in 0.431s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:50 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59 Aug 25 06:59:50 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:50 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:50 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:50 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-quobyte-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59" released by "delete_volume" :: held 0.872s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:50 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.404s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Deleted volume successfully. Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Created reservations ['24ad439a-93e3-4731-8b55-3456d54ce6db', 'dd9745c3-48b4-4cec-a9fd-657d4769da0a', '6fcbb473-47e7-4d2b-8b2e-eccaf664d3f2', '43df6432-db5a-43be-96ba-abb0a3f2b48d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Flow 'volume_create_manager' (e3a7b9a9-f385-4927-85c2-91edf14d91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2001de6a-d133-4d34-bbc2-055c04d6eeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c3c4be81-ee9b-407f-ac01-c448780b8da4 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-5075d67f-b9df-4b20-95ba-c60e1b27d634-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2001de6a-d133-4d34-bbc2-055c04d6eeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2114660920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca60c481-6b60-4578-81ce-753779aa132c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c92375a03f74fa4b22a4f0ac34af4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:51Z,use_quota=True,user_id='ffb8ee3ba65e4bc7917609a506b973b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5d097-eeff-48b6-a435-e2fcc569bd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5d097-eeff-48b6-a435-e2fcc569bd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ece389-ffc3-4ef3-a0ea-792c0348c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ece389-ffc3-4ef3-a0ea-792c0348c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca60c481-6b60-4578-81ce-753779aa132c', 'volume_name': 'volume-ca60c481-6b60-4578-81ce-753779aa132c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ecfe5d-4664-4f7c-8eac-77d9a4fb372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ecfe5d-4664-4f7c-8eac-77d9a4fb372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96db1283-f059-465a-840d-9b2e6d5504ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Volume ca60c481-6b60-4578-81ce-753779aa132c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca60c481-6b60-4578-81ce-753779aa132c', 'volume_size': 1} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2114660920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca60c481-6b60-4578-81ce-753779aa132c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c92375a03f74fa4b22a4f0ac34af4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:51Z,use_quota=True,user_id='ffb8ee3ba65e4bc7917609a506b973b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Creating volume ca60c481-6b60-4578-81ce-753779aa132c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:51 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c 1073741824 Aug 25 06:59:51 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:51 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:51 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 06:59:51 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Flow 'volume_create_manager' (f8816c27-cefe-42d7-93ad-579f2640f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e4a1f-614d-46bf-aaaf-017e32b92669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.334s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e4a1f-614d-46bf-aaaf-017e32b92669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-741323889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6b4bf2-8165-4c60-855f-960b6dde689d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7395dc96a8f4055a81f2d5c3b9728d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:51Z,use_quota=True,user_id='e01298140c62493789be0f74f9b2fd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d01096-54eb-49d4-b2ec-164df0810c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d01096-54eb-49d4-b2ec-164df0810c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de90212-8676-4d65-909c-19507941b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de90212-8676-4d65-909c-19507941b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6b4bf2-8165-4c60-855f-960b6dde689d', 'volume_name': 'volume-6f6b4bf2-8165-4c60-855f-960b6dde689d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943d6001-e0c8-4f16-916f-0a2f4a15e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943d6001-e0c8-4f16-916f-0a2f4a15e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7351036a-be26-4e35-b617-8da606b6c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Volume 6f6b4bf2-8165-4c60-855f-960b6dde689d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6b4bf2-8165-4c60-855f-960b6dde689d', 'volume_size': 1} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Deleted volume successfully. Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea059400-b262-4944-8648-05378e18c0b0 tempest-VolumesSnapshotNegativeTestJSON-2029231921 None] Lock "cinder-84a31ce8-8bc9-473c-9ec6-08ebd5e38c59-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:51 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c 1073741824" returned: 0 in 0.575s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:51 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c Aug 25 06:59:51 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:51 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c" returned: 0 in 0.244s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T04:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-741323889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6b4bf2-8165-4c60-855f-960b6dde689d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7395dc96a8f4055a81f2d5c3b9728d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T04:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T04:59:51Z,use_quota=True,user_id='e01298140c62493789be0f74f9b2fd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Creating volume 6f6b4bf2-8165-4c60-855f-960b6dde689d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96db1283-f059-465a-840d-9b2e6d5504ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca60c481-6b60-4578-81ce-753779aa132c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d 1073741824 Aug 25 06:59:51 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5792cd-5240-4dd9-837d-e095ae1ec3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Volume volume-ca60c481-6b60-4578-81ce-753779aa132c (ca60c481-6b60-4578-81ce-753779aa132c): created successfully Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5792cd-5240-4dd9-837d-e095ae1ec3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Flow 'volume_create_manager' (e3a7b9a9-f385-4927-85c2-91edf14d91bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3a43c30f-bdb0-403c-a388-f896cb20c3cc tempest-AttachVolumeNegativeTest-634367111 None] Created volume successfully. Aug 25 06:59:52 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d 1073741824" returned: 0 in 0.571s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:52 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d Aug 25 06:59:52 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:52 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7351036a-be26-4e35-b617-8da606b6c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6b4bf2-8165-4c60-855f-960b6dde689d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0206bd9c-3e84-49a7-b201-a43c78bc3e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 06:59:52 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Volume volume-6f6b4bf2-8165-4c60-855f-960b6dde689d (6f6b4bf2-8165-4c60-855f-960b6dde689d): created successfully Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0206bd9c-3e84-49a7-b201-a43c78bc3e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 06:59:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Flow 'volume_create_manager' (f8816c27-cefe-42d7-93ad-579f2640f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 06:59:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c9f368e8-f254-430c-ba85-db9d598e18b7 tempest-ProjectReaderTests-1042747083 None] Created volume successfully. Aug 25 06:59:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "cinder-6f6b4bf2-8165-4c60-855f-960b6dde689d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-6f6b4bf2-8165-4c60-855f-960b6dde689d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "cinder-quobyte-6f6b4bf2-8165-4c60-855f-960b6dde689d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 06:59:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-quobyte-6f6b4bf2-8165-4c60-855f-960b6dde689d" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 06:59:53 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c0444-32c3-4435-a388-28b1a10a04e3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 06:59:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:54 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d Aug 25 06:59:54 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-29e8befc-7ee8-49d8-8efc-118b5ad5d468 req-c5fd5d81-09b4-4c1b-a179-3a87b38d3441 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-29e8befc-7ee8-49d8-8efc-118b5ad5d468 req-c5fd5d81-09b4-4c1b-a179-3a87b38d3441 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-29e8befc-7ee8-49d8-8efc-118b5ad5d468 req-c5fd5d81-09b4-4c1b-a179-3a87b38d3441 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-29e8befc-7ee8-49d8-8efc-118b5ad5d468 req-c5fd5d81-09b4-4c1b-a179-3a87b38d3441 tempest-AttachVolumeNegativeTest-634367111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-ca60c481-6b60-4578-81ce-753779aa132c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8de4ca0e-ca08-496b-8048-069296eab006', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 06:59:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-29e8befc-7ee8-49d8-8efc-118b5ad5d468 req-c5fd5d81-09b4-4c1b-a179-3a87b38d3441 tempest-AttachVolumeNegativeTest-634367111 None] attachment_update completed successfully. Aug 25 06:59:54 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d" returned: 0 in 0.554s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:54 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d Aug 25 06:59:54 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:54 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-6f6b4bf2-8165-4c60-855f-960b6dde689d" returned: 0 in 0.442s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-quobyte-6f6b4bf2-8165-4c60-855f-960b6dde689d" released by "delete_volume" :: held 1.067s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:54 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Created reservations ['5327c6b2-dff1-4d1a-9c24-9c9efb3cb626', 'd52784ad-fae9-437c-a91f-7a2c8c8821bf', 'dc63664c-bf01-467d-8b0e-259a83d63e8e', 'fc755fbc-7e31-477c-9767-b25185ea27e5'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 06:59:55 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 06:59:55 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 06:59:55 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.417s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 06:59:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Deleted volume successfully. Aug 25 06:59:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-20c39f52-b40a-4e4c-a706-e68bcfb09c37 tempest-ProjectReaderTests-1042747083 None] Lock "cinder-6f6b4bf2-8165-4c60-855f-960b6dde689d-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 06:59:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-659fca60-2ea6-42da-a9ef-07ae8fa4fb84 req-25f5bcd9-8f20-4908-8603-7f8ab8ba4517 tempest-AttachVolumeNegativeTest-634367111 None] Terminate volume connection completed successfully. Aug 25 06:59:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-659fca60-2ea6-42da-a9ef-07ae8fa4fb84 req-25f5bcd9-8f20-4908-8603-7f8ab8ba4517 tempest-AttachVolumeNegativeTest-634367111 None] Deleting attachment 8de4ca0e-ca08-496b-8048-069296eab006. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:00:08 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=46,cinder:INSERT=14,cinder:UPDATE=65,cinder:DELETE=7 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:00:08 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=52,cinder:INSERT=15,cinder:UPDATE=51,cinder:DELETE=2 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Flow 'volume_create_manager' (bb7aeb0b-0e15-460c-8a30-b1bf8b92be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02fcb4b-73d7-40a1-b0a5-a0c2cebd1e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02fcb4b-73d7-40a1-b0a5-a0c2cebd1e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1921106527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249483d1-012a-45a3-994d-a4b6dfc017d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368d5bfbd6594efaaed90d762e215ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:11Z,use_quota=True,user_id='7077fa953520403fb0554f5c77d47051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c15695-dbdd-45eb-b010-114f9023fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c15695-dbdd-45eb-b010-114f9023fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f797459-f7cb-47b7-a8c8-ea8f3eb0bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f797459-f7cb-47b7-a8c8-ea8f3eb0bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249483d1-012a-45a3-994d-a4b6dfc017d9', 'volume_name': 'volume-249483d1-012a-45a3-994d-a4b6dfc017d9', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71a78ab-33d0-44d3-8989-bf9c4b091a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71a78ab-33d0-44d3-8989-bf9c4b091a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdd57f-1f35-4c85-ae84-2ba9a49f9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Volume 249483d1-012a-45a3-994d-a4b6dfc017d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249483d1-012a-45a3-994d-a4b6dfc017d9', 'volume_size': 1} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1921106527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249483d1-012a-45a3-994d-a4b6dfc017d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368d5bfbd6594efaaed90d762e215ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:11Z,use_quota=True,user_id='7077fa953520403fb0554f5c77d47051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Creating volume 249483d1-012a-45a3-994d-a4b6dfc017d9 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:11 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:11 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 1073741824 Aug 25 07:00:11 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:11 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 1073741824" returned: 0 in 0.740s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:12 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 Aug 25 07:00:12 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:12 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9" returned: 0 in 0.364s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdd57f-1f35-4c85-ae84-2ba9a49f9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249483d1-012a-45a3-994d-a4b6dfc017d9', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c92b6d-f1ab-4b4f-b3ac-a23dcba3ec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:12 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Volume volume-249483d1-012a-45a3-994d-a4b6dfc017d9 (249483d1-012a-45a3-994d-a4b6dfc017d9): created successfully Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c92b6d-f1ab-4b4f-b3ac-a23dcba3ec13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Flow 'volume_create_manager' (bb7aeb0b-0e15-460c-8a30-b1bf8b92be0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ccab227b-ad59-4573-b1b5-3adca886c0c6 tempest-TestMinimumBasicScenario-1180234642 None] Created volume successfully. Aug 25 07:00:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-52833eb9-ddb5-4f8e-9e9c-4de95ef3093b req-617ef4d5-9cf5-4c4a-a2cc-6a2a3b4ceeeb tempest-TestMinimumBasicScenario-1180234642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-52833eb9-ddb5-4f8e-9e9c-4de95ef3093b req-617ef4d5-9cf5-4c4a-a2cc-6a2a3b4ceeeb tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-52833eb9-ddb5-4f8e-9e9c-4de95ef3093b req-617ef4d5-9cf5-4c4a-a2cc-6a2a3b4ceeeb tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-52833eb9-ddb5-4f8e-9e9c-4de95ef3093b req-617ef4d5-9cf5-4c4a-a2cc-6a2a3b4ceeeb tempest-TestMinimumBasicScenario-1180234642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-249483d1-012a-45a3-994d-a4b6dfc017d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66f5a72e-26c2-486a-942f-6b2e23ca802d', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:00:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-52833eb9-ddb5-4f8e-9e9c-4de95ef3093b req-617ef4d5-9cf5-4c4a-a2cc-6a2a3b4ceeeb tempest-TestMinimumBasicScenario-1180234642 None] attachment_update completed successfully. Aug 25 07:00:25 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:00:25 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=5,cinder:SELECT=11 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:31 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:00:31 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Flow 'volume_create_manager' (cde0b1cd-8d34-479b-a8a7-811851fc3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcca446-4318-43e0-9a0c-f72ca53dd2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcca446-4318-43e0-9a0c-f72ca53dd2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1641233351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8decad79-7395-4951-b8ac-076d523c8f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12db95d68d43959a056206f479b818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:32Z,use_quota=True,user_id='606383ce22df4ef6b138eea05a6306be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7438dffb-a8d1-48e7-8bf8-134e11019138),volume_type_id=7438dffb-a8d1-48e7-8bf8-134e11019138)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a80dc6-e8a4-44c8-9a26-e45580955349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a80dc6-e8a4-44c8-9a26-e45580955349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14a4794-8bdf-4340-87ab-93c09026c21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14a4794-8bdf-4340-87ab-93c09026c21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8decad79-7395-4951-b8ac-076d523c8f8c', 'volume_name': 'volume-8decad79-7395-4951-b8ac-076d523c8f8c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042cacd-5340-4fc4-ba4c-52113932050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042cacd-5340-4fc4-ba4c-52113932050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4dbc55-2c14-48b9-b63a-9521d4501401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume 8decad79-7395-4951-b8ac-076d523c8f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8decad79-7395-4951-b8ac-076d523c8f8c', 'volume_size': 1} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1641233351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8decad79-7395-4951-b8ac-076d523c8f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12db95d68d43959a056206f479b818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:32Z,use_quota=True,user_id='606383ce22df4ef6b138eea05a6306be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7438dffb-a8d1-48e7-8bf8-134e11019138),volume_type_id=7438dffb-a8d1-48e7-8bf8-134e11019138)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Creating volume 8decad79-7395-4951-b8ac-076d523c8f8c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:32 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:32 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.447s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:00:32 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c 1073741824 Aug 25 07:00:32 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:32 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Flow 'volume_create_manager' (b19436b4-168d-4715-966b-59a5d0ecbd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f521769-3ba1-4eaf-8228-9781ef25f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c 1073741824" returned: 0 in 0.783s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f521769-3ba1-4eaf-8228-9781ef25f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-540486600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d247c983-fffb-4822-ac53-6f81621a1817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12db95d68d43959a056206f479b818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:33Z,use_quota=True,user_id='606383ce22df4ef6b138eea05a6306be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10ea061a-b32e-40ef-a727-94d9dec8238d),volume_type_id=10ea061a-b32e-40ef-a727-94d9dec8238d)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47949145-7c96-4257-94e5-5ff1be53de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47949145-7c96-4257-94e5-5ff1be53de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa39434-bcf3-43b6-927d-01f6a368a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa39434-bcf3-43b6-927d-01f6a368a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd247c983-fffb-4822-ac53-6f81621a1817', 'volume_name': 'volume-d247c983-fffb-4822-ac53-6f81621a1817', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12368ee-6684-4b22-a0d3-e676fe1054b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12368ee-6684-4b22-a0d3-e676fe1054b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e164ff-e5d1-4e3e-9419-31a43e90998f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:33 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume d247c983-fffb-4822-ac53-6f81621a1817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d247c983-fffb-4822-ac53-6f81621a1817', 'volume_size': 1} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:33 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c Aug 25 07:00:33 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:33 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c" returned: 0 in 0.632s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-540486600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d247c983-fffb-4822-ac53-6f81621a1817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12db95d68d43959a056206f479b818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:33Z,use_quota=True,user_id='606383ce22df4ef6b138eea05a6306be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10ea061a-b32e-40ef-a727-94d9dec8238d),volume_type_id=10ea061a-b32e-40ef-a727-94d9dec8238d)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Creating volume d247c983-fffb-4822-ac53-6f81621a1817 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:33 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4dbc55-2c14-48b9-b63a-9521d4501401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8decad79-7395-4951-b8ac-076d523c8f8c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad77811e-843e-4fdf-b1c2-fe38d092d580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:33 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 1073741824 Aug 25 07:00:33 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:33 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume volume-8decad79-7395-4951-b8ac-076d523c8f8c (8decad79-7395-4951-b8ac-076d523c8f8c): created successfully Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad77811e-843e-4fdf-b1c2-fe38d092d580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Flow 'volume_create_manager' (cde0b1cd-8d34-479b-a8a7-811851fc3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:33 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a2a09610-3d1f-46c8-98ed-79569bf7fe55 tempest-TestInstancesWithCinderVolumes-2002553930 None] Created volume successfully. Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Flow 'volume_create_manager' (0f083ae1-127c-4704-b700-aef240eab544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae5cdda-f10b-4174-adf3-31118d70c161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae5cdda-f10b-4174-adf3-31118d70c161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1909783617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f351eb-827b-4d9c-a85b-c614d2909919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12db95d68d43959a056206f479b818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:34Z,use_quota=True,user_id='606383ce22df4ef6b138eea05a6306be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40fd588d-3739-4812-ab6b-4fbd12d97b31),volume_type_id=40fd588d-3739-4812-ab6b-4fbd12d97b31)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfba465-0980-459e-9e17-2a6dd041a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfba465-0980-459e-9e17-2a6dd041a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbebda1-309a-481a-b27d-3d2a51462faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbebda1-309a-481a-b27d-3d2a51462faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99f351eb-827b-4d9c-a85b-c614d2909919', 'volume_name': 'volume-99f351eb-827b-4d9c-a85b-c614d2909919', 'volume_size': 1, 'image_id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7666a4b-040b-4561-8bca-1c359cd975d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--41847661', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d12db95d68d43959a056206f479b818', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'created_at': datetime.datetime(2026, 8, 25, 5, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7666a4b-040b-4561-8bca-1c359cd975d5/file', 'properties': {}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7240d2de-21d7-400d-ac3a-eb023fb84440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:34 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7240d2de-21d7-400d-ac3a-eb023fb84440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4568b6dd-7dcd-411e-8f65-98342f2bf979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume 99f351eb-827b-4d9c-a85b-c614d2909919: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99f351eb-827b-4d9c-a85b-c614d2909919', 'volume_size': 1, 'image_id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7666a4b-040b-4561-8bca-1c359cd975d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--41847661', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d12db95d68d43959a056206f479b818', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'created_at': datetime.datetime(2026, 8, 25, 5, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7666a4b-040b-4561-8bca-1c359cd975d5/file', 'properties': {}}, 'image_service': } Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Trying to clone 99f351eb-827b-4d9c-a85b-c614d2909919 from image e7666a4b-040b-4561-8bca-1c359cd975d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7666a4b-040b-4561-8bca-1c359cd975d5', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 1073741824" returned: 0 in 0.578s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:34 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 Aug 25 07:00:34 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:34 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e164ff-e5d1-4e3e-9419-31a43e90998f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d247c983-fffb-4822-ac53-6f81621a1817', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636efc62-e895-4a23-9f09-31a7dd015f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume volume-d247c983-fffb-4822-ac53-6f81621a1817 (d247c983-fffb-4822-ac53-6f81621a1817): created successfully Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636efc62-e895-4a23-9f09-31a7dd015f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Flow 'volume_create_manager' (b19436b4-168d-4715-966b-59a5d0ecbd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-27a5e29f-ccf7-4d70-a5a5-b8a9cbea59a8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Created volume successfully. Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD, size 20.69 MB, duration 3.09 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:00:37 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Image download 20.69 MB at 6.70 MB/s Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[db878bfa-6c03-483d-ba8f-ca6c9dfdd876]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:37 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD Aug 25 07:00:37 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:37 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Temporary image e7666a4b-040b-4561-8bca-1c359cd975d5 is fetched for user 606383ce22df4ef6b138eea05a6306be. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e289985f-6a5a-445d-a1e7-6e1bc1156c2f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:37 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD Aug 25 07:00:37 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:38 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1909783617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f351eb-827b-4d9c-a85b-c614d2909919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d12db95d68d43959a056206f479b818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:34Z,use_quota=True,user_id='606383ce22df4ef6b138eea05a6306be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40fd588d-3739-4812-ab6b-4fbd12d97b31),volume_type_id=40fd588d-3739-4812-ab6b-4fbd12d97b31)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Creating volume 99f351eb-827b-4d9c-a85b-c614d2909919 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:38 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:38 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 1073741824 Aug 25 07:00:38 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:38 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 1073741824" returned: 0 in 0.439s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:38 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 Aug 25 07:00:38 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:38 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Attempting download of e7666a4b-040b-4561-8bca-1c359cd975d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7666a4b-040b-4561-8bca-1c359cd975d5', 'metadata': {}}])) to volume 99f351eb-827b-4d9c-a85b-c614d2909919. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df10e52-f239-4c2e-a863-356d4acc8d6f]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:39 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au Aug 25 07:00:39 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:39 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:39 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au Aug 25 07:00:39 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:39 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au" returned: 1 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7666a4b-040b-4561-8bca-1c359cd975d5_88mo03au' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce2e53b-819b-420b-9819-55ac3beaeec0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:39 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD Aug 25 07:00:39 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:39 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] e7666a4b-040b-4561-8bca-1c359cd975d5 was qcow2, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:00:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:40 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 Aug 25 07:00:40 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:41 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919" returned: 0 in 1.745s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:41 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7666a4b-040b-4561-8bca-1c359cd975d5_s5z1_cgadevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:00:41 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Converted 112.00 MB image at 64.15 MB/s Aug 25 07:00:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:41 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 1G Aug 25 07:00:41 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:42 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 1G" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Downloaded image e7666a4b-040b-4561-8bca-1c359cd975d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7666a4b-040b-4561-8bca-1c359cd975d5', 'metadata': {}}])) to volume 99f351eb-827b-4d9c-a85b-c614d2909919 successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Temporary image e7666a4b-040b-4561-8bca-1c359cd975d5 for user 606383ce22df4ef6b138eea05a6306be is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Marking volume 99f351eb-827b-4d9c-a85b-c614d2909919 as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Copying metadata from image e7666a4b-040b-4561-8bca-1c359cd975d5 to 99f351eb-827b-4d9c-a85b-c614d2909919. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Creating volume glance metadata for volume 99f351eb-827b-4d9c-a85b-c614d2909919 backed by image e7666a4b-040b-4561-8bca-1c359cd975d5 with: {'image_id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'image_name': 'tempest-scenario-img--41847661', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4568b6dd-7dcd-411e-8f65-98342f2bf979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f351eb-827b-4d9c-a85b-c614d2909919', 'volume_size': 1, 'image_id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7666a4b-040b-4561-8bca-1c359cd975d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--41847661', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2d12db95d68d43959a056206f479b818', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e7666a4b-040b-4561-8bca-1c359cd975d5', 'created_at': datetime.datetime(2026, 8, 25, 5, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7666a4b-040b-4561-8bca-1c359cd975d5/file', 'properties': {}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d76bc0-c9e7-41b8-a81a-297a788b5ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:42 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Volume volume-99f351eb-827b-4d9c-a85b-c614d2909919 (99f351eb-827b-4d9c-a85b-c614d2909919): created successfully Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d76bc0-c9e7-41b8-a81a-297a788b5ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Flow 'volume_create_manager' (0f083ae1-127c-4704-b700-aef240eab544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:42 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-74031a8b-46f0-4633-982e-57d384f7496b tempest-TestInstancesWithCinderVolumes-2002553930 None] Created volume successfully. Aug 25 07:00:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-d5f3ffe0-412e-4411-ab87-2e9ffe1cf652 req-2c9177db-779b-4a3e-99b3-532266ba0860 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-d5f3ffe0-412e-4411-ab87-2e9ffe1cf652 req-2c9177db-779b-4a3e-99b3-532266ba0860 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-d5f3ffe0-412e-4411-ab87-2e9ffe1cf652 req-2c9177db-779b-4a3e-99b3-532266ba0860 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-d5f3ffe0-412e-4411-ab87-2e9ffe1cf652 req-2c9177db-779b-4a3e-99b3-532266ba0860 tempest-TestInstancesWithCinderVolumes-2002553930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-99f351eb-827b-4d9c-a85b-c614d2909919', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ae81507-1e1e-40b8-8370-45afc5385d26', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:00:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-d5f3ffe0-412e-4411-ab87-2e9ffe1cf652 req-2c9177db-779b-4a3e-99b3-532266ba0860 tempest-TestInstancesWithCinderVolumes-2002553930 None] attachment_update completed successfully. Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Flow 'volume_create_manager' (42fdadfd-cde1-49cf-9182-58c21350ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b5e22-b733-44da-93de-69eaa359a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b5e22-b733-44da-93de-69eaa359a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2080526713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8d7a7b-43e3-4675-8416-0031eb7a8e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c92375a03f74fa4b22a4f0ac34af4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:51Z,use_quota=True,user_id='ffb8ee3ba65e4bc7917609a506b973b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a06b53-a047-4a65-9e48-cd4518f24b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a06b53-a047-4a65-9e48-cd4518f24b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad2fae9-2efd-4efa-8a4a-8b969ed78f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad2fae9-2efd-4efa-8a4a-8b969ed78f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8d7a7b-43e3-4675-8416-0031eb7a8e94', 'volume_name': 'volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8132451c-c7b1-4024-9514-8c4d30a14250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8132451c-c7b1-4024-9514-8c4d30a14250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a9a1e8-ca08-457e-8f7f-0147d79b6603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Volume 7c8d7a7b-43e3-4675-8416-0031eb7a8e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94', 'volume_size': 1} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2080526713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8d7a7b-43e3-4675-8416-0031eb7a8e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c92375a03f74fa4b22a4f0ac34af4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:00:51Z,use_quota=True,user_id='ffb8ee3ba65e4bc7917609a506b973b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Creating volume 7c8d7a7b-43e3-4675-8416-0031eb7a8e94 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:00:50 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:00:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:50 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 1073741824 Aug 25 07:00:50 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:51 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 1073741824" returned: 0 in 0.500s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:00:51 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 Aug 25 07:00:51 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:00:51 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94" returned: 0 in 0.274s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a9a1e8-ca08-457e-8f7f-0147d79b6603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706fa658-0337-4fb9-8cda-048314d66f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:00:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Volume volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 (7c8d7a7b-43e3-4675-8416-0031eb7a8e94): created successfully Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706fa658-0337-4fb9-8cda-048314d66f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:00:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Flow 'volume_create_manager' (42fdadfd-cde1-49cf-9182-58c21350ec64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:00:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e4d9dd26-ad95-4d37-aaff-a243998908b2 tempest-AttachVolumeNegativeTest-634367111 None] Created volume successfully. Aug 25 07:00:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-98f1b9c9-27d5-463b-bc1e-fff3c8f318f9 req-532b0ae4-0cc9-4dd5-b9c0-eb8f67434bb0 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:00:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-98f1b9c9-27d5-463b-bc1e-fff3c8f318f9 req-532b0ae4-0cc9-4dd5-b9c0-eb8f67434bb0 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:00:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-98f1b9c9-27d5-463b-bc1e-fff3c8f318f9 req-532b0ae4-0cc9-4dd5-b9c0-eb8f67434bb0 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:00:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-98f1b9c9-27d5-463b-bc1e-fff3c8f318f9 req-532b0ae4-0cc9-4dd5-b9c0-eb8f67434bb0 tempest-AttachVolumeNegativeTest-634367111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daa7852a-83b4-43e2-94bb-61c0ee2fb79e', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:00:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-98f1b9c9-27d5-463b-bc1e-fff3c8f318f9 req-532b0ae4-0cc9-4dd5-b9c0-eb8f67434bb0 tempest-AttachVolumeNegativeTest-634367111 None] attachment_update completed successfully. Aug 25 07:00:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-5973cb6e-46e9-4bd5-b18a-be9b67bd630c req-cbd3194f-5d48-4254-8fcc-0297d85dcdc2 tempest-AttachVolumeNegativeTest-634367111 None] Terminate volume connection completed successfully. Aug 25 07:00:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-5973cb6e-46e9-4bd5-b18a-be9b67bd630c req-cbd3194f-5d48-4254-8fcc-0297d85dcdc2 tempest-AttachVolumeNegativeTest-634367111 None] Deleting attachment daa7852a-83b4-43e2-94bb-61c0ee2fb79e. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "cinder-7c8d7a7b-43e3-4675-8416-0031eb7a8e94-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-7c8d7a7b-43e3-4675-8416-0031eb7a8e94-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "cinder-quobyte-7c8d7a7b-43e3-4675-8416-0031eb7a8e94" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-quobyte-7c8d7a7b-43e3-4675-8416-0031eb7a8e94" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb83b85-08a6-4ff3-bf11-3bcfa32dc6db]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:03 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 Aug 25 07:01:03 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:03 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94" returned: 0 in 0.358s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:03 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94 Aug 25 07:01:03 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:04 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c8d7a7b-43e3-4675-8416-0031eb7a8e94" returned: 0 in 0.257s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-quobyte-7c8d7a7b-43e3-4675-8416-0031eb7a8e94" released by "delete_volume" :: held 0.666s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Created reservations ['a39d9f9d-050c-4159-9739-23048bdf12fe', '395403ba-24c8-4138-b800-0a85af83af42', '56220e56-e4d0-498d-8e1a-a5d227f8dfe1', '34b64abe-450b-4857-8d44-f5ff5b49bf16'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:04 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:04 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.283s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Deleted volume successfully. Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c003e07-1905-4338-9c6a-7c9543b3ce36 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-7c8d7a7b-43e3-4675-8416-0031eb7a8e94-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "cinder-ca60c481-6b60-4578-81ce-753779aa132c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-ca60c481-6b60-4578-81ce-753779aa132c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "cinder-quobyte-ca60c481-6b60-4578-81ce-753779aa132c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-quobyte-ca60c481-6b60-4578-81ce-753779aa132c" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624f323-aba7-4f11-ab0a-12cff182cd50]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:04 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c Aug 25 07:01:04 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c" returned: 0 in 0.354s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:05 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c Aug 25 07:01:05 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca60c481-6b60-4578-81ce-753779aa132c" returned: 0 in 0.241s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-quobyte-ca60c481-6b60-4578-81ce-753779aa132c" released by "delete_volume" :: held 0.636s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Created reservations ['75bc9c17-e09c-4d13-91a1-99747d391c16', '2ebd6ab5-3610-4004-ba2e-9979b1b60ff5', '3443277f-4cf7-44c4-a625-f0ac991a7192', '43d904eb-fcf6-4b9f-b813-f05bad0a2032'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:05 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:05 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:05 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.245s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Deleted volume successfully. Aug 25 07:01:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8aa0646e-2c58-4cb6-8fdd-e5cbc9f5a5b4 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-ca60c481-6b60-4578-81ce-753779aa132c-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "cinder-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "cinder-quobyte-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-quobyte-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4375ea3-e1d4-410c-85ca-21ca022c4291]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:06 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 Aug 25 07:01:06 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:06 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1" returned: 0 in 0.382s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:06 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1 Aug 25 07:01:06 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:06 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1" returned: 0 in 0.301s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-quobyte-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1" released by "delete_volume" :: held 0.727s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:06 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Created reservations ['0260c267-b788-488b-8ced-ae5a5fc72b83', 'dd3bee26-023b-444c-a445-557b38392513', '4eac607e-af9a-41c2-abbc-b5681e7f0153', '22d4f7dd-5d46-4f5f-8e33-4d4921b917f0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:07 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:07 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:07 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.276s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:07 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Deleted volume successfully. Aug 25 07:01:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b6842c3b-5208-4d9b-9b13-d987d6861699 tempest-AttachVolumeNegativeTest-634367111 None] Lock "cinder-ffedf3c0-c8f4-41ab-a504-d04e7cb02af1-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Flow 'volume_create_manager' (4f899b13-789d-4598-b917-d674fcf9386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca9e23c-765b-4c0d-8330-5e697f799761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca9e23c-765b-4c0d-8330-5e697f799761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-494107888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab71000d-a11b-458a-ad27-cdbecd6900da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a844e722904e4daea9b6bee7ebce1614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:15Z,use_quota=True,user_id='2f7a2a2f57384e5e8dc2d3c76a06cc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b37bb6e-25aa-4acb-807a-475069209d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b37bb6e-25aa-4acb-807a-475069209d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d29373-47a2-4155-955a-11791cb66c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d29373-47a2-4155-955a-11791cb66c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab71000d-a11b-458a-ad27-cdbecd6900da', 'volume_name': 'volume-ab71000d-a11b-458a-ad27-cdbecd6900da', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2e571e-ca10-4824-a9ff-554be24e2c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2e571e-ca10-4824-a9ff-554be24e2c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d1fdee-8983-4787-9ac4-6680b8d6c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:15 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Volume ab71000d-a11b-458a-ad27-cdbecd6900da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab71000d-a11b-458a-ad27-cdbecd6900da', 'volume_size': 1} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-494107888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab71000d-a11b-458a-ad27-cdbecd6900da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a844e722904e4daea9b6bee7ebce1614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:15Z,use_quota=True,user_id='2f7a2a2f57384e5e8dc2d3c76a06cc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Creating volume ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:15 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:15 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da 1073741824 Aug 25 07:01:15 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:15 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da 1073741824" returned: 0 in 0.439s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:15 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da Aug 25 07:01:15 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:15 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d1fdee-8983-4787-9ac4-6680b8d6c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab71000d-a11b-458a-ad27-cdbecd6900da', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815036c1-7f01-45ec-8c4f-a51bae2a2103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Volume volume-ab71000d-a11b-458a-ad27-cdbecd6900da (ab71000d-a11b-458a-ad27-cdbecd6900da): created successfully Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815036c1-7f01-45ec-8c4f-a51bae2a2103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Flow 'volume_create_manager' (4f899b13-789d-4598-b917-d674fcf9386c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-769a23c0-2bb2-4502-b09c-2bb2cb95fcc3 req-21cc9edb-6656-4354-adb2-0699ec5ea86b tempest-VolumesSnapshotsTestJSON-947546196 None] Created volume successfully. Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Creating offline snapshot cf9ce501-7214-4b51-9a45-b0a40c3b58b3 of volume ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366edaf-bbf7-48fe-97d9-8ddae927b808]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:16 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da Aug 25 07:01:16 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:16 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da" returned: 0 in 0.413s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:16 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 1G Aug 25 07:01:16 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:17 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 1G" returned: 0 in 0.430s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab71000d-a11b-458a-ad27-cdbecd6900da -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:17 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab71000d-a11b-458a-ad27-cdbecd6900da -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 Aug 25 07:01:17 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:17 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab71000d-a11b-458a-ad27-cdbecd6900da -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3" returned: 0 in 0.283s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:17 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 is being set with open permissions: ugo+rw Aug 25 07:01:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:17 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 Aug 25 07:01:17 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:17 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3" returned: 0 in 0.244s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:17 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info Aug 25 07:01:17 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:18 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info" returned: 0 in 0.257s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:18 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info is being set with open permissions: ugo+rw Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:18 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info Aug 25 07:01:18 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:18 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.info" returned: 0 in 0.253s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-980b54f2-d48d-4f85-b95f-674363d3399f req-74724842-261c-4adf-9784-58fe527918bf tempest-VolumesSnapshotsTestJSON-947546196 None] Create snapshot completed successfully Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "cinder-cf9ce501-7214-4b51-9a45-b0a40c3b58b3-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-cf9ce501-7214-4b51-9a45-b0a40c3b58b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "cinder-quobyte-ab71000d-a11b-458a-ad27-cdbecd6900da" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-quobyte-ab71000d-a11b-458a-ad27-cdbecd6900da" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "cinder-quobyte-cf9ce501-7214-4b51-9a45-b0a40c3b58b3" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-quobyte-cf9ce501-7214-4b51-9a45-b0a40c3b58b3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Deleting offline snapshot cf9ce501-7214-4b51-9a45-b0a40c3b58b3 of volume ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] snapshot_file for this snap is: volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764e7df-4536-4f59-9f53-44f67b9749bb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:19 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 Aug 25 07:01:19 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:19 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3" returned: 0 in 0.404s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab71000d-a11b-458a-ad27-cdbecd6900da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[65225f10-78b4-4dc6-a37a-724285affc18]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:19 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da Aug 25 07:01:19 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:19 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da" returned: 0 in 0.412s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:19 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 Aug 25 07:01:19 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:20 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:20 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3 Aug 25 07:01:20 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:20 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da.cf9ce501-7214-4b51-9a45-b0a40c3b58b3" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-quobyte-cf9ce501-7214-4b51-9a45-b0a40c3b58b3" released by "_delete_snapshot" :: held 1.517s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-quobyte-ab71000d-a11b-458a-ad27-cdbecd6900da" released by "delete_snapshot" :: held 1.550s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG cinder.quota [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Created reservations ['7ec7c62c-5b1c-486c-ae62-9d8218810d2e', 'cb917a55-3bb9-4333-afa2-3740086d0821', '9805f7b1-efc1-4226-9291-f4fc6ecaf23b', 'edfa5dbc-1582-474c-9159-88f3f98d63e6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:20 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Delete snapshot completed successfully. Aug 25 07:01:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-4ace08b5-a92d-438d-90e0-18077fb9b690 req-c10ab1d3-6727-4ca7-be6b-4504412fce9d tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-cf9ce501-7214-4b51-9a45-b0a40c3b58b3-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "cinder-ab71000d-a11b-458a-ad27-cdbecd6900da-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-ab71000d-a11b-458a-ad27-cdbecd6900da-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "cinder-quobyte-ab71000d-a11b-458a-ad27-cdbecd6900da" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-quobyte-ab71000d-a11b-458a-ad27-cdbecd6900da" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9690897e-5138-4d6f-8e7b-287d6c361b15]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:21 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da Aug 25 07:01:21 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:21 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da" returned: 0 in 0.364s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:21 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da Aug 25 07:01:21 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:21 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ab71000d-a11b-458a-ad27-cdbecd6900da" returned: 0 in 0.242s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-quobyte-ab71000d-a11b-458a-ad27-cdbecd6900da" released by "delete_volume" :: held 0.672s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.quota [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Created reservations ['a5fd9c1f-0da2-4203-ac5a-80c122e26f99', '42231799-e486-47b5-aab3-ac3e09d0d45a', '6d6a08e3-74d6-446a-bc29-9dd4fff9fd3c', 'fb6516bb-ae4c-482d-a7dd-da1a6300aa7f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:22 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:22 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:22 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.229s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:22 devstack cinder-volume[94460]: DEBUG cinder.manager [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Deleted volume successfully. Aug 25 07:01:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-bb567f52-a622-43e7-9428-7ba8f168a3a8 req-7c1a3e60-a6cb-4c07-ab61-e76b72fc49ae tempest-VolumesSnapshotsTestJSON-947546196 None] Lock "cinder-ab71000d-a11b-458a-ad27-cdbecd6900da-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-c012a2c0-9fdb-40ea-89ab-aad6cc320ecd req-2679f5bc-5a28-458f-ba40-164f459738ed tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-c012a2c0-9fdb-40ea-89ab-aad6cc320ecd req-2679f5bc-5a28-458f-ba40-164f459738ed tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-c012a2c0-9fdb-40ea-89ab-aad6cc320ecd req-2679f5bc-5a28-458f-ba40-164f459738ed tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-c012a2c0-9fdb-40ea-89ab-aad6cc320ecd req-2679f5bc-5a28-458f-ba40-164f459738ed tempest-TestInstancesWithCinderVolumes-2002553930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-8decad79-7395-4951-b8ac-076d523c8f8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd688504-ab69-436d-98f1-5b6ec82fd987', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:01:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-c012a2c0-9fdb-40ea-89ab-aad6cc320ecd req-2679f5bc-5a28-458f-ba40-164f459738ed tempest-TestInstancesWithCinderVolumes-2002553930 None] attachment_update completed successfully. Aug 25 07:01:25 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=71,cinder:UPDATE=58,cinder:DELETE=6,cinder:INSERT=19 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:01:25 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=63,cinder:SELECT=62,cinder:INSERT=16,cinder:DELETE=4 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:01:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-1f4963c0-da25-4744-b63e-752efc291c07 req-be530ca3-eb52-452d-ac76-70f606ecb828 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-1f4963c0-da25-4744-b63e-752efc291c07 req-be530ca3-eb52-452d-ac76-70f606ecb828 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-1f4963c0-da25-4744-b63e-752efc291c07 req-be530ca3-eb52-452d-ac76-70f606ecb828 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-1f4963c0-da25-4744-b63e-752efc291c07 req-be530ca3-eb52-452d-ac76-70f606ecb828 tempest-TestInstancesWithCinderVolumes-2002553930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-d247c983-fffb-4822-ac53-6f81621a1817', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10131e97-7a54-48ce-8330-8bae79bd97f7', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:01:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-1f4963c0-da25-4744-b63e-752efc291c07 req-be530ca3-eb52-452d-ac76-70f606ecb828 tempest-TestInstancesWithCinderVolumes-2002553930 None] attachment_update completed successfully. Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Flow 'volume_create_manager' (b06892a5-46dc-41f0-9961-49a716fee78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d236197d-7973-4174-ae47-e2a76f31fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d236197d-7973-4174-ae47-e2a76f31fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1789840376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713b1829-6e66-4d1b-9a02-99ff89b2cfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41450f421af946ee8a9f5ffc32dcf334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:27Z,use_quota=True,user_id='fe528e8922b64de889c4b7fa5d6a69e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a838e69-cc06-4a6f-a113-f7fd569f8627),volume_type_id=1a838e69-cc06-4a6f-a113-f7fd569f8627)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc555991-acf0-458b-99ee-2ffba8959345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc555991-acf0-458b-99ee-2ffba8959345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5afc99-aac9-4e2e-a1e2-c955e018ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5afc99-aac9-4e2e-a1e2-c955e018ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713b1829-6e66-4d1b-9a02-99ff89b2cfaa', 'volume_name': 'volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c003dd-0d7a-4bfa-bdef-47a3054a34c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c003dd-0d7a-4bfa-bdef-47a3054a34c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b7cd30-689b-4e02-bf08-8ac527ee6cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:27 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Volume 713b1829-6e66-4d1b-9a02-99ff89b2cfaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa', 'volume_size': 1} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1789840376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713b1829-6e66-4d1b-9a02-99ff89b2cfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41450f421af946ee8a9f5ffc32dcf334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:27Z,use_quota=True,user_id='fe528e8922b64de889c4b7fa5d6a69e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a838e69-cc06-4a6f-a113-f7fd569f8627),volume_type_id=1a838e69-cc06-4a6f-a113-f7fd569f8627)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Creating volume 713b1829-6e66-4d1b-9a02-99ff89b2cfaa {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:27 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:27 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa 1073741824 Aug 25 07:01:27 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:27 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa 1073741824" returned: 0 in 0.567s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:27 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa Aug 25 07:01:27 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:28 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa" returned: 0 in 0.296s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b7cd30-689b-4e02-bf08-8ac527ee6cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d095f5d0-fbd1-47c8-bf19-3b567b34317d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:28 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Volume volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa (713b1829-6e66-4d1b-9a02-99ff89b2cfaa): created successfully Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d095f5d0-fbd1-47c8-bf19-3b567b34317d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Flow 'volume_create_manager' (b06892a5-46dc-41f0-9961-49a716fee78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-856952cd-acd2-40e4-ae79-da2fe730f64d req-dd4041e6-60a4-48c7-9e16-53a840dbaa49 tempest-TestMinimumBasicScenario-1180234642 None] Terminate volume connection completed successfully. Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-856952cd-acd2-40e4-ae79-da2fe730f64d req-dd4041e6-60a4-48c7-9e16-53a840dbaa49 tempest-TestMinimumBasicScenario-1180234642 None] Deleting attachment 66f5a72e-26c2-486a-942f-6b2e23ca802d. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:01:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-227d181b-fd7b-4df2-a093-59f9ff2dc1f0 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Created volume successfully. Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Acquiring lock "cinder-249483d1-012a-45a3-994d-a4b6dfc017d9-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Lock "cinder-249483d1-012a-45a3-994d-a4b6dfc017d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Acquiring lock "cinder-quobyte-249483d1-012a-45a3-994d-a4b6dfc017d9" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Lock "cinder-quobyte-249483d1-012a-45a3-994d-a4b6dfc017d9" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69234fb-0ac9-46ed-89db-3a2aae3f60bf]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 Aug 25 07:01:29 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9" returned: 0 in 0.396s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9 Aug 25 07:01:29 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:29 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-249483d1-012a-45a3-994d-a4b6dfc017d9" returned: 0 in 0.290s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Lock "cinder-quobyte-249483d1-012a-45a3-994d-a4b6dfc017d9" released by "delete_volume" :: held 0.733s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Created reservations ['98575534-3a49-443d-8751-181711b11b3a', '42dcbec4-4fc4-4212-a8a9-33e5a654d9d2', '573cf383-427a-4577-9c22-51d1efc5cc30', 'eb030692-3280-43c7-89bc-fe52adbe54a0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:29 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:29 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:29 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.288s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:29 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:29 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-89169124-169e-45ed-b36d-18925138c1cf tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Retype volume completed successfully. Aug 25 07:01:30 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:30 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Deleted volume successfully. Aug 25 07:01:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bf156578-34f7-4bc6-b31b-29fd117c8354 tempest-TestMinimumBasicScenario-1180234642 None] Lock "cinder-249483d1-012a-45a3-994d-a4b6dfc017d9-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Acquiring lock "cinder-713b1829-6e66-4d1b-9a02-99ff89b2cfaa-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "cinder-713b1829-6e66-4d1b-9a02-99ff89b2cfaa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Acquiring lock "cinder-quobyte-713b1829-6e66-4d1b-9a02-99ff89b2cfaa" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "cinder-quobyte-713b1829-6e66-4d1b-9a02-99ff89b2cfaa" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848a2e2-c963-4f77-af57-25b71dddda99]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:31 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa Aug 25 07:01:31 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:31 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa" returned: 0 in 0.559s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:31 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa Aug 25 07:01:31 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:31 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:31 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:32 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-713b1829-6e66-4d1b-9a02-99ff89b2cfaa" returned: 0 in 0.316s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "cinder-quobyte-713b1829-6e66-4d1b-9a02-99ff89b2cfaa" released by "delete_volume" :: held 0.925s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:32 devstack cinder-volume[94460]: WARNING cinder.quota [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:32 devstack cinder-volume[94460]: WARNING cinder.quota [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:32 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Created reservations ['931d74d9-2ac7-4814-885e-f214304e829f', '3a4dcd13-ee9c-4d24-8778-524402aadf81', 'bfc2de4c-319c-4c16-8f3f-d1e5eac980a3', 'c7874be9-95ef-45e2-9535-65a18eff3c76'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:32 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:32 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-bfd22744-666a-4cff-9480-cf7a60cc8f4c req-92c89d95-6be3-42dd-95ae-71ddb8f95ba8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Terminate volume connection completed successfully. Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-bfd22744-666a-4cff-9480-cf7a60cc8f4c req-92c89d95-6be3-42dd-95ae-71ddb8f95ba8 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deleting attachment dd688504-ab69-436d-98f1-5b6ec82fd987. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:01:32 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.278s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Deleted volume successfully. Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ddc1d297-7d49-48bf-92d1-efcd5bb30248 tempest-VolumeRetypeWithoutMigrationTest-1392595808 None] Lock "cinder-713b1829-6e66-4d1b-9a02-99ff89b2cfaa-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "cinder-8decad79-7395-4951-b8ac-076d523c8f8c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-8decad79-7395-4951-b8ac-076d523c8f8c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "cinder-quobyte-8decad79-7395-4951-b8ac-076d523c8f8c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-quobyte-8decad79-7395-4951-b8ac-076d523c8f8c" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea869bf-fe5a-4cfa-a460-0d974f68632c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:32 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c Aug 25 07:01:32 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:33 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c" returned: 0 in 0.406s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:33 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c Aug 25 07:01:33 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:33 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8decad79-7395-4951-b8ac-076d523c8f8c" returned: 0 in 0.324s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-quobyte-8decad79-7395-4951-b8ac-076d523c8f8c" released by "delete_volume" :: held 0.781s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:33 devstack cinder-volume[94460]: WARNING cinder.quota [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1982937376-1512853619 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1982937376-1512853619, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:33 devstack cinder-volume[94460]: WARNING cinder.quota [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1982937376-1512853619 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1982937376-1512853619, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Created reservations ['33571e52-6a10-47ce-98b8-08b728cff580', 'a150c1f3-c00f-4725-82a2-f8903376bfc9', '08c6dbac-b829-4472-a7bf-80be8967a15e', 'e1719a8a-b8e2-4026-9ced-13ec4f87a35e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:33 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:33 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:34 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.450s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:34 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deleted volume successfully. Aug 25 07:01:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0abff39e-06c3-41f6-bb58-d3e11ddf7aa1 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-8decad79-7395-4951-b8ac-076d523c8f8c-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-6bdbddc5-9689-4cae-85cd-af25e2754a4b req-5172a74b-d168-4f40-a961-45b476e4f175 tempest-TestInstancesWithCinderVolumes-2002553930 None] Terminate volume connection completed successfully. Aug 25 07:01:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-6bdbddc5-9689-4cae-85cd-af25e2754a4b req-5172a74b-d168-4f40-a961-45b476e4f175 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deleting attachment 10131e97-7a54-48ce-8330-8bae79bd97f7. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:01:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "cinder-d247c983-fffb-4822-ac53-6f81621a1817-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-d247c983-fffb-4822-ac53-6f81621a1817-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "cinder-quobyte-d247c983-fffb-4822-ac53-6f81621a1817" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-quobyte-d247c983-fffb-4822-ac53-6f81621a1817" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[276bf31a-aec2-4385-a9db-2eee6ae4edab]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:38 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 Aug 25 07:01:38 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:38 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817" returned: 0 in 0.454s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:38 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817 Aug 25 07:01:38 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:38 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d247c983-fffb-4822-ac53-6f81621a1817" returned: 0 in 0.287s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-quobyte-d247c983-fffb-4822-ac53-6f81621a1817" released by "delete_volume" :: held 0.812s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:38 devstack cinder-volume[94460]: WARNING cinder.quota [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942620749-1363481730 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942620749-1363481730, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:38 devstack cinder-volume[94460]: WARNING cinder.quota [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942620749-1363481730 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1942620749-1363481730, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Created reservations ['170b001f-286e-460e-8e1e-7b3b7cfc0258', 'b5de5496-31ac-46ce-b342-c15a260a9cb9', '53c43b90-a5ee-412e-8ae8-919e6e693231', '0b691b87-1c27-44d5-aa50-3c34f971fbe0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:39 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:39 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:39 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.378s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:39 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Deleted volume successfully. Aug 25 07:01:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dca965c2-0f99-4411-891b-4cdec28c7668 tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-d247c983-fffb-4822-ac53-6f81621a1817-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Flow 'volume_create_manager' (b29c2380-f59b-4117-85af-61e469d592f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93eafd4a-e070-4638-8d3e-60c779e3fea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93eafd4a-e070-4638-8d3e-60c779e3fea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1511462986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0237f14a-67f0-4059-bef7-c1ed72091cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a21b68fa30482d87a7fb26868bb909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:40Z,use_quota=True,user_id='98ca87180ac3482c98a0b9d51a626340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53ac2b-98eb-4e66-acaa-29cab7b663af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec53ac2b-98eb-4e66-acaa-29cab7b663af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2c11e8-1c26-436d-9f94-0d28787396bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2c11e8-1c26-436d-9f94-0d28787396bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0237f14a-67f0-4059-bef7-c1ed72091cc5', 'volume_name': 'volume-0237f14a-67f0-4059-bef7-c1ed72091cc5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37611c8a-d84f-49d0-9b11-51b4d2db3bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37611c8a-d84f-49d0-9b11-51b4d2db3bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b347f5af-e784-43f1-8432-0510497e1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Volume 0237f14a-67f0-4059-bef7-c1ed72091cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0237f14a-67f0-4059-bef7-c1ed72091cc5', 'volume_size': 1} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1511462986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0237f14a-67f0-4059-bef7-c1ed72091cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a21b68fa30482d87a7fb26868bb909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:40Z,use_quota=True,user_id='98ca87180ac3482c98a0b9d51a626340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Creating volume 0237f14a-67f0-4059-bef7-c1ed72091cc5 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:40 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:01:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:40 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 1073741824 Aug 25 07:01:40 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:41 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 1073741824" returned: 0 in 0.623s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:41 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 Aug 25 07:01:41 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:41 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5" returned: 0 in 0.323s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b347f5af-e784-43f1-8432-0510497e1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0237f14a-67f0-4059-bef7-c1ed72091cc5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073cc8f2-dad8-4ced-9762-11dd39558985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Volume volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 (0237f14a-67f0-4059-bef7-c1ed72091cc5): created successfully Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073cc8f2-dad8-4ced-9762-11dd39558985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Flow 'volume_create_manager' (b29c2380-f59b-4117-85af-61e469d592f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3b4d665e-ccb4-4686-a7d3-4e9f403c129d tempest-VolumesServicesTestJSON-2132841218 None] Created volume successfully. Aug 25 07:01:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Acquiring lock "cinder-0237f14a-67f0-4059-bef7-c1ed72091cc5-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Lock "cinder-0237f14a-67f0-4059-bef7-c1ed72091cc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Acquiring lock "cinder-quobyte-0237f14a-67f0-4059-bef7-c1ed72091cc5" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Lock "cinder-quobyte-0237f14a-67f0-4059-bef7-c1ed72091cc5" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b1be5-6aa3-4b97-87ff-fbc92dfa796f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:42 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 Aug 25 07:01:42 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:43 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5" returned: 0 in 0.513s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:43 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5 Aug 25 07:01:43 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-202194a2-dc1a-4583-afe6-1c1eb4ac7f04 req-b69c2788-f617-4c65-a9ff-9c721e57ce5e tempest-TestInstancesWithCinderVolumes-2002553930 None] Terminate volume connection completed successfully. Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-202194a2-dc1a-4583-afe6-1c1eb4ac7f04 req-b69c2788-f617-4c65-a9ff-9c721e57ce5e tempest-TestInstancesWithCinderVolumes-2002553930 None] Deleting attachment 5ae81507-1e1e-40b8-8370-45afc5385d26. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:01:43 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0237f14a-67f0-4059-bef7-c1ed72091cc5" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Lock "cinder-quobyte-0237f14a-67f0-4059-bef7-c1ed72091cc5" released by "delete_volume" :: held 0.888s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Created reservations ['4a1295f2-8ff9-4e24-a795-020598c84d29', '2b9bf1df-70e9-43fd-abaf-a94ed0999ac4', '55e20d56-efd7-4c93-8bee-a200e511e711', 'eae4dcb2-3e1e-40d9-b159-5604a785e976'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:43 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:43 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:44 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.349s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Deleted volume successfully. Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc01ce0c-e60c-4794-865f-e6545cab8094 tempest-VolumesServicesTestJSON-2132841218 None] Lock "cinder-0237f14a-67f0-4059-bef7-c1ed72091cc5-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "cinder-99f351eb-827b-4d9c-a85b-c614d2909919-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-99f351eb-827b-4d9c-a85b-c614d2909919-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "cinder-quobyte-99f351eb-827b-4d9c-a85b-c614d2909919" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-quobyte-99f351eb-827b-4d9c-a85b-c614d2909919" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[97da06ff-3ad1-4bdb-a9b2-7c47c5089a34]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:44 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 Aug 25 07:01:44 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:45 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:45 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919 Aug 25 07:01:45 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:45 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-99f351eb-827b-4d9c-a85b-c614d2909919" returned: 0 in 0.296s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-quobyte-99f351eb-827b-4d9c-a85b-c614d2909919" released by "delete_volume" :: held 0.795s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:45 devstack cinder-volume[94460]: WARNING cinder.quota [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277063147-1012910714 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277063147-1012910714, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:45 devstack cinder-volume[94460]: WARNING cinder.quota [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277063147-1012910714 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1277063147-1012910714, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Created reservations ['8349ff39-e956-43b7-950b-bea08afb2486', '83e9dba2-4754-48ac-99ef-de7def00c34d', '36f5d981-1da1-46b2-875a-0dfcb8a8f746', '9b638593-1be0-4d13-af15-8199062840c1'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:45 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:01:45 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:46 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.321s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:46 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:01:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Deleted volume successfully. Aug 25 07:01:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3bcae77e-f3d6-44dc-ae2e-10fbd60a2d6e tempest-TestInstancesWithCinderVolumes-2002553930 None] Lock "cinder-99f351eb-827b-4d9c-a85b-c614d2909919-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Flow 'volume_create_manager' (78336db5-0aac-4a99-a23a-d859729fa337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05126a4-2a7f-4249-8bb7-440154a251f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05126a4-2a7f-4249-8bb7-440154a251f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1157801809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f188b147-ee3e-4124-be53-1ac47cc946ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f26ad5832c1421a8c18ba8c59886f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:51Z,use_quota=True,user_id='418b8383b1354eb7b81d04aecc3c5465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3a9e91-0782-401b-8fac-5bdfc8fbbf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3a9e91-0782-401b-8fac-5bdfc8fbbf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c152bc03-756a-4a56-a7b9-5d7e12b01523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c152bc03-756a-4a56-a7b9-5d7e12b01523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f188b147-ee3e-4124-be53-1ac47cc946ab', 'volume_name': 'volume-f188b147-ee3e-4124-be53-1ac47cc946ab', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b5bf46-a786-411f-9670-ff4fff31c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b5bf46-a786-411f-9670-ff4fff31c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa1f3b9-98e1-4cbb-9042-077b7abb0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Volume f188b147-ee3e-4124-be53-1ac47cc946ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f188b147-ee3e-4124-be53-1ac47cc946ab', 'volume_size': 1} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1157801809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f188b147-ee3e-4124-be53-1ac47cc946ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f26ad5832c1421a8c18ba8c59886f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:01:51Z,use_quota=True,user_id='418b8383b1354eb7b81d04aecc3c5465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Creating volume f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:01:50 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:01:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:50 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab 1073741824 Aug 25 07:01:50 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:51 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab 1073741824" returned: 0 in 0.449s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:51 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab Aug 25 07:01:51 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:51 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab" returned: 0 in 0.287s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa1f3b9-98e1-4cbb-9042-077b7abb0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f188b147-ee3e-4124-be53-1ac47cc946ab', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcc56f3-3e4e-4848-b8d6-23341eb4832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:01:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Volume volume-f188b147-ee3e-4124-be53-1ac47cc946ab (f188b147-ee3e-4124-be53-1ac47cc946ab): created successfully Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcc56f3-3e4e-4848-b8d6-23341eb4832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:01:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Flow 'volume_create_manager' (78336db5-0aac-4a99-a23a-d859729fa337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:01:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ff422b81-9918-46db-be9f-1fe54dab1d6b tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Created volume successfully. Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Creating offline snapshot f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 of volume f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b262001-8df3-4fd1-8e3a-7afa2fc48a44]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:53 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab Aug 25 07:01:53 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:53 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab" returned: 0 in 0.487s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:53 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 1G Aug 25 07:01:53 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:54 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 1G" returned: 0 in 0.569s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f188b147-ee3e-4124-be53-1ac47cc946ab -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:54 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f188b147-ee3e-4124-be53-1ac47cc946ab -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 Aug 25 07:01:54 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:54 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f188b147-ee3e-4124-be53-1ac47cc946ab -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" returned: 0 in 0.365s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:54 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 is being set with open permissions: ugo+rw Aug 25 07:01:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:54 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 Aug 25 07:01:54 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:54 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" returned: 0 in 0.313s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:54 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info Aug 25 07:01:54 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:55 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info" returned: 0 in 0.320s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:55 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info is being set with open permissions: ugo+rw Aug 25 07:01:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:55 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info Aug 25 07:01:55 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:55 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.info" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:01:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4befdc0f-af5d-4dfd-8b78-519e8ab488f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Create snapshot completed successfully Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "cinder-f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "cinder-quobyte-f188b147-ee3e-4124-be53-1ac47cc946ab" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-quobyte-f188b147-ee3e-4124-be53-1ac47cc946ab" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "cinder-quobyte-f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-quobyte-f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Deleting offline snapshot f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 of volume f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] snapshot_file for this snap is: volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72156c0-2f0d-4ef0-9c9d-e815dc893a2d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:57 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 Aug 25 07:01:57 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:57 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" returned: 0 in 0.456s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f188b147-ee3e-4124-be53-1ac47cc946ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:01:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a67dcd-ed1b-4d7c-a3ed-9e752e47bdba]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:57 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab Aug 25 07:01:57 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:57 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab" returned: 0 in 0.447s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:57 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 Aug 25 07:01:57 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:58 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" returned: 0 in 0.456s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:58 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8 Aug 25 07:01:58 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:58 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab.f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" returned: 0 in 0.301s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-quobyte-f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8" released by "_delete_snapshot" :: held 1.815s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-quobyte-f188b147-ee3e-4124-be53-1ac47cc946ab" released by "delete_snapshot" :: held 1.849s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Created reservations ['8a3ad82b-e3ce-4d86-836b-7f28e7006578', 'bd6a48d1-95bd-45ad-97d5-05805e41003c', 'd700b026-6bb7-4269-bef0-def7a0645bd6', '76f5a55a-a855-4e42-95c9-8edd72c0eb88'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:01:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Delete snapshot completed successfully. Aug 25 07:01:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4520f0f7-624e-44e6-be01-7796190b598d tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-f29a39cb-9b2a-4bb4-ba61-6d6266ff44c8-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "cinder-f188b147-ee3e-4124-be53-1ac47cc946ab-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-f188b147-ee3e-4124-be53-1ac47cc946ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "cinder-quobyte-f188b147-ee3e-4124-be53-1ac47cc946ab" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-quobyte-f188b147-ee3e-4124-be53-1ac47cc946ab" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3c2e83-d466-4150-b988-059514cdc06c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:59 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab Aug 25 07:01:59 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:01:59 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab" returned: 0 in 0.502s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:01:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:01:59 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab Aug 25 07:01:59 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:00 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f188b147-ee3e-4124-be53-1ac47cc946ab" returned: 0 in 0.351s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-quobyte-f188b147-ee3e-4124-be53-1ac47cc946ab" released by "delete_volume" :: held 0.999s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Created reservations ['24059502-5fcc-4e35-b86f-755e45fe9a97', '4197ed8e-6cdd-4055-a1c1-33c9353834e8', 'aa5f6e0c-1f5a-4d5b-af5f-d5e43dc6672d', '7c9d5ab3-06f0-480f-bd0d-94d17d4eb77d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:00 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:00 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:00 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Deleted volume successfully. Aug 25 07:02:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2c26ad2-bf66-47e7-ac52-103ca031f4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1937521729 None] Lock "cinder-f188b147-ee3e-4124-be53-1ac47cc946ab-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:04 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Flow 'volume_create_manager' (9b9754a8-a1ad-4a16-8d56-e657ddefdf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f0ccfa-84bb-4536-9ebf-10ca10a0bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f0ccfa-84bb-4536-9ebf-10ca10a0bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308ad081-d709-413f-86f2-8eb6f7ea1e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f6aeaf04ff425aa233810664ee06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:05Z,use_quota=True,user_id='10c1eb5719624d3d98b69f088189b156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a8632a-40a1-44c5-a221-72fe615a59c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a8632a-40a1-44c5-a221-72fe615a59c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f02ffe-70b6-4f7c-b8f1-275b805800ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f02ffe-70b6-4f7c-b8f1-275b805800ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '308ad081-d709-413f-86f2-8eb6f7ea1e93', 'volume_name': 'volume-308ad081-d709-413f-86f2-8eb6f7ea1e93', 'volume_size': 1, 'image_id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2038197c9bab850cebe722720969469', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56f6aeaf04ff425aa233810664ee06c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a72b51eb84f24da7d0245cd37c0753617f3a0b4b2209ec1d20b086441f82a05b3b751b959858308636169c38dff6e1b5ddc5243df7e169a09d4a04ad1a68724f', 'id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'created_at': datetime.datetime(2026, 8, 25, 5, 2, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 2, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b/file', 'properties': {}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55f0229-1b2c-467d-966d-edcf677f942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55f0229-1b2c-467d-966d-edcf677f942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fed366a-4502-44f0-8b9c-ccbc30e6fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:05 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Volume 308ad081-d709-413f-86f2-8eb6f7ea1e93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-308ad081-d709-413f-86f2-8eb6f7ea1e93', 'volume_size': 1, 'image_id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2038197c9bab850cebe722720969469', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56f6aeaf04ff425aa233810664ee06c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a72b51eb84f24da7d0245cd37c0753617f3a0b4b2209ec1d20b086441f82a05b3b751b959858308636169c38dff6e1b5ddc5243df7e169a09d4a04ad1a68724f', 'id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'created_at': datetime.datetime(2026, 8, 25, 5, 2, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 2, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b/file', 'properties': {}}, 'image_service': } Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Trying to clone 308ad081-d709-413f-86f2-8eb6f7ea1e93 from image 7e47aec9-824c-4a8b-84ff-6c9647b4b27b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:02:05 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[42869f23-83e2-43a8-8d8d-4691b7215430]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:05 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD Aug 25 07:02:05 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:05 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:06 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD Aug 25 07:02:06 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:06 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Temporary image 7e47aec9-824c-4a8b-84ff-6c9647b4b27b is fetched for user 10c1eb5719624d3d98b69f088189b156. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[85433751-1990-42e2-a629-2fdca0526d44]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:06 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD Aug 25 07:02:06 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:06 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:07 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD Aug 25 07:02:07 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:07 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308ad081-d709-413f-86f2-8eb6f7ea1e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f6aeaf04ff425aa233810664ee06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:05Z,use_quota=True,user_id='10c1eb5719624d3d98b69f088189b156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Creating volume 308ad081-d709-413f-86f2-8eb6f7ea1e93 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:07 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:07 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 1073741824 Aug 25 07:02:07 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:07 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 1073741824" returned: 0 in 0.528s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:07 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 Aug 25 07:02:07 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:08 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93" returned: 0 in 0.295s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Attempting download of 7e47aec9-824c-4a8b-84ff-6c9647b4b27b ((None, [{'url': 'file:///opt/stack/data/glance/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'metadata': {}}])) to volume 308ad081-d709-413f-86f2-8eb6f7ea1e93. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[151f75bf-690b-4bca-a886-154e421ed2b2]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:08 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr Aug 25 07:02:08 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:08 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr" returned: 0 in 0.508s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:08 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr Aug 25 07:02:08 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:09 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr" returned: 1 in 0.370s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_afoxcdbr' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7016c60-26b0-432d-97f5-5f824851fde6]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:09 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD Aug 25 07:02:09 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:09 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:09 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD Aug 25 07:02:09 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:09 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] 7e47aec9-824c-4a8b-84ff-6c9647b4b27b was raw, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:02:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:09 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 Aug 25 07:02:09 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:10 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93" returned: 0 in 0.638s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:10 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e47aec9-824c-4a8b-84ff-6c9647b4b27b_3tjrkelqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:02:10 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:02:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:10 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 1G Aug 25 07:02:10 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:11 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 1G" returned: 0 in 0.525s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Downloaded image 7e47aec9-824c-4a8b-84ff-6c9647b4b27b ((None, [{'url': 'file:///opt/stack/data/glance/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'metadata': {}}])) to volume 308ad081-d709-413f-86f2-8eb6f7ea1e93 successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Temporary image 7e47aec9-824c-4a8b-84ff-6c9647b4b27b for user 10c1eb5719624d3d98b69f088189b156 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Marking volume 308ad081-d709-413f-86f2-8eb6f7ea1e93 as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Copying metadata from image 7e47aec9-824c-4a8b-84ff-6c9647b4b27b to 308ad081-d709-413f-86f2-8eb6f7ea1e93. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Creating volume glance metadata for volume 308ad081-d709-413f-86f2-8eb6f7ea1e93 backed by image 7e47aec9-824c-4a8b-84ff-6c9647b4b27b with: {'image_id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd2038197c9bab850cebe722720969469', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fed366a-4502-44f0-8b9c-ccbc30e6fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308ad081-d709-413f-86f2-8eb6f7ea1e93', 'volume_size': 1, 'image_id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2038197c9bab850cebe722720969469', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56f6aeaf04ff425aa233810664ee06c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a72b51eb84f24da7d0245cd37c0753617f3a0b4b2209ec1d20b086441f82a05b3b751b959858308636169c38dff6e1b5ddc5243df7e169a09d4a04ad1a68724f', 'id': '7e47aec9-824c-4a8b-84ff-6c9647b4b27b', 'created_at': datetime.datetime(2026, 8, 25, 5, 2, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 2, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e47aec9-824c-4a8b-84ff-6c9647b4b27b/file', 'properties': {}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5f9e89-b102-45de-976a-85c49434e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Volume volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 (308ad081-d709-413f-86f2-8eb6f7ea1e93): created successfully Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5f9e89-b102-45de-976a-85c49434e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Flow 'volume_create_manager' (9b9754a8-a1ad-4a16-8d56-e657ddefdf53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a5cb6559-1114-4b92-9940-a29dd869731f tempest-VolumeImageDependencyTests-751165549 None] Created volume successfully. Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Acquiring lock "cinder-308ad081-d709-413f-86f2-8eb6f7ea1e93-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Lock "cinder-308ad081-d709-413f-86f2-8eb6f7ea1e93-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Acquiring lock "cinder-quobyte-308ad081-d709-413f-86f2-8eb6f7ea1e93" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Lock "cinder-quobyte-308ad081-d709-413f-86f2-8eb6f7ea1e93" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d7fc96-5e76-47a4-aec4-50185effc6f4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:11 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 Aug 25 07:02:11 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:12 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:12 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93 Aug 25 07:02:12 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:12 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-308ad081-d709-413f-86f2-8eb6f7ea1e93" returned: 0 in 0.306s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Lock "cinder-quobyte-308ad081-d709-413f-86f2-8eb6f7ea1e93" released by "delete_volume" :: held 0.761s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Created reservations ['19bcef1d-eef3-462f-ada9-39df4ba46fe0', '7b47f448-3446-4e52-8f10-4ccd6ea62305', '8c199f95-76fb-4cdf-a6d7-0dc17d105f7c', '5d4c832b-fc09-4575-8455-8437aac3d2c2'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:12 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:12 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:12 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Deleted volume successfully. Aug 25 07:02:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3380736a-6fe4-4628-a551-dacb3bd29b48 tempest-VolumeImageDependencyTests-751165549 None] Lock "cinder-308ad081-d709-413f-86f2-8eb6f7ea1e93-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:22 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=79,cinder:UPDATE=96,cinder:INSERT=26,cinder:DELETE=6 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:02:22 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=79,cinder:UPDATE=85,cinder:INSERT=24,cinder:DELETE=7 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:31 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:31 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:32 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:02:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:02:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:02:39 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (64a288a3-7493-4453-8e76-4b81a007c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a01042-aef4-4607-b36a-1f733d050d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a01042-aef4-4607-b36a-1f733d050d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77249346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a936a1a1-c537-4ae7-864f-09300142b876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:40Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac36635-91a3-4608-91a1-8373baaa09b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac36635-91a3-4608-91a1-8373baaa09b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a017e145-9392-4468-9ef9-bab3f7eeef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a017e145-9392-4468-9ef9-bab3f7eeef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a936a1a1-c537-4ae7-864f-09300142b876', 'volume_name': 'volume-a936a1a1-c537-4ae7-864f-09300142b876', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ee0c9-8fba-45ff-b9c9-1f9e55a05dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ee0c9-8fba-45ff-b9c9-1f9e55a05dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dab32eb-e5e2-4bb9-9a9a-8854fdfc7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Volume a936a1a1-c537-4ae7-864f-09300142b876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a936a1a1-c537-4ae7-864f-09300142b876', 'volume_size': 1} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77249346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a936a1a1-c537-4ae7-864f-09300142b876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:40Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Creating volume a936a1a1-c537-4ae7-864f-09300142b876 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:40 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:40 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 1073741824 Aug 25 07:02:40 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:40 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 1073741824" returned: 0 in 0.422s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:40 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 Aug 25 07:02:40 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:40 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876" returned: 0 in 0.244s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dab32eb-e5e2-4bb9-9a9a-8854fdfc7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a936a1a1-c537-4ae7-864f-09300142b876', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a9ddf2-bf2e-4483-b47b-cfbbc06db1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Volume volume-a936a1a1-c537-4ae7-864f-09300142b876 (a936a1a1-c537-4ae7-864f-09300142b876): created successfully Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a9ddf2-bf2e-4483-b47b-cfbbc06db1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (64a288a3-7493-4453-8e76-4b81a007c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c247f319-e287-4e1d-bdcf-c7ee000dc06e tempest-VolumesActionsTest-1054953301 None] Created volume successfully. Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7a5ad640-8fe9-446d-8e8d-4cfcb6765132 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876" by "attach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7a5ad640-8fe9-446d-8e8d-4cfcb6765132 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876" acquired by "attach_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7a5ad640-8fe9-446d-8e8d-4cfcb6765132 tempest-VolumesActionsTest-1054953301 None] Attaching volume a936a1a1-c537-4ae7-864f-09300142b876 to instance 8e62856a-1d3e-4786-8c54-5fab9acd4bfa at mountpoint /dev/vdb on host None. Aug 25 07:02:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7a5ad640-8fe9-446d-8e8d-4cfcb6765132 tempest-VolumesActionsTest-1054953301 None] Attach volume completed successfully. Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7a5ad640-8fe9-446d-8e8d-4cfcb6765132 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876" released by "attach_volume" :: held 0.082s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f3bbf778-12d3-4eef-bbf9-d34305e9f24f tempest-VolumesActionsTest-1255973205 None] Terminate volume connection completed successfully. Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f3bbf778-12d3-4eef-bbf9-d34305e9f24f tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-detach_volume" by "detach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f3bbf778-12d3-4eef-bbf9-d34305e9f24f tempest-VolumesActionsTest-1255973205 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f3bbf778-12d3-4eef-bbf9-d34305e9f24f tempest-VolumesActionsTest-1255973205 None] Detaching volume a936a1a1-c537-4ae7-864f-09300142b876 from instance 8e62856a-1d3e-4786-8c54-5fab9acd4bfa. Aug 25 07:02:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f3bbf778-12d3-4eef-bbf9-d34305e9f24f tempest-VolumesActionsTest-1255973205 None] Detach volume completed successfully. Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f3bbf778-12d3-4eef-bbf9-d34305e9f24f tempest-VolumesActionsTest-1255973205 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c214943b-124e-49be-acc5-edbe617b2330 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-detach_volume" by "detach_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c214943b-124e-49be-acc5-edbe617b2330 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c214943b-124e-49be-acc5-edbe617b2330 tempest-VolumesActionsTest-1054953301 None] Volume detach called, but volume not attached. Aug 25 07:02:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c214943b-124e-49be-acc5-edbe617b2330 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Acquiring lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Acquiring lock "cinder-quobyte-a936a1a1-c537-4ae7-864f-09300142b876" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Lock "cinder-quobyte-a936a1a1-c537-4ae7-864f-09300142b876" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb02ce0-5e00-44fa-860a-69b845ab701f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:42 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 Aug 25 07:02:42 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:42 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876" returned: 0 in 0.365s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:42 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876 Aug 25 07:02:42 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:42 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a936a1a1-c537-4ae7-864f-09300142b876" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Lock "cinder-quobyte-a936a1a1-c537-4ae7-864f-09300142b876" released by "delete_volume" :: held 0.655s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Created reservations ['6c4255be-ce14-4e8d-9319-9367e36f9b35', '40b946d8-03a0-4e8d-b68d-760800eb794c', '06b833e7-2065-410b-b87a-ce14994d4673', '8f2eb009-6cb6-4891-9fca-c32d59dcc761'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:42 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:42 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:43 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.257s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:43 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Deleted volume successfully. Aug 25 07:02:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cfe277e2-91be-4f63-9a30-0b7f459969be tempest-VolumesActionsTest-1054953301 None] Lock "cinder-a936a1a1-c537-4ae7-864f-09300142b876-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (185cf3d8-f1b0-4f23-ac42-8ab031963618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be33ed37-f118-47bc-a4ed-3f41dc6f07f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be33ed37-f118-47bc-a4ed-3f41dc6f07f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355447338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745b08aa-c8b6-44dd-9223-ba25ca8817db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:47Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451369e2-001c-4ac3-afa2-eb95b51e8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451369e2-001c-4ac3-afa2-eb95b51e8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd89bbd-fc6d-459e-bf0a-e70e623713e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd89bbd-fc6d-459e-bf0a-e70e623713e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745b08aa-c8b6-44dd-9223-ba25ca8817db', 'volume_name': 'volume-745b08aa-c8b6-44dd-9223-ba25ca8817db', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f263cc-707c-4ae9-83b1-33ca9fc230da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f263cc-707c-4ae9-83b1-33ca9fc230da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8140073e-2b10-4861-a861-83f920f95e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Volume 745b08aa-c8b6-44dd-9223-ba25ca8817db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745b08aa-c8b6-44dd-9223-ba25ca8817db', 'volume_size': 1} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355447338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745b08aa-c8b6-44dd-9223-ba25ca8817db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:47Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Creating volume 745b08aa-c8b6-44dd-9223-ba25ca8817db {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:46 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:46 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db 1073741824 Aug 25 07:02:46 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:47 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db 1073741824" returned: 0 in 0.413s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:47 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db Aug 25 07:02:47 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:47 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db" returned: 0 in 0.247s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8140073e-2b10-4861-a861-83f920f95e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745b08aa-c8b6-44dd-9223-ba25ca8817db', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf05a0f-b855-49c9-b7c9-f076dba13900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:47 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Volume volume-745b08aa-c8b6-44dd-9223-ba25ca8817db (745b08aa-c8b6-44dd-9223-ba25ca8817db): created successfully Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf05a0f-b855-49c9-b7c9-f076dba13900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (185cf3d8-f1b0-4f23-ac42-8ab031963618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-374d8dcb-99f7-4a2e-b133-6cc85c324346 tempest-VolumesActionsTest-1054953301 None] Created volume successfully. Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-745b08aa-c8b6-44dd-9223-ba25ca8817db-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-745b08aa-c8b6-44dd-9223-ba25ca8817db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-quobyte-745b08aa-c8b6-44dd-9223-ba25ca8817db" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-745b08aa-c8b6-44dd-9223-ba25ca8817db" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2159c4-db1c-4dfd-ad5a-9c81f36cf998]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:47 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db Aug 25 07:02:47 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:48 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db" returned: 0 in 0.349s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:48 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db Aug 25 07:02:48 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:48 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-745b08aa-c8b6-44dd-9223-ba25ca8817db" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-745b08aa-c8b6-44dd-9223-ba25ca8817db" released by "delete_volume" :: held 0.647s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Created reservations ['543d9bd9-003f-4064-80e1-6c1df3b2a9ec', '0216d1cf-41aa-4e5a-8249-7001e13d1d63', 'e5e6f10a-168d-4608-8a1c-a196a1b4a54f', '63426594-14d0-46b4-89c1-a9d2cbec9d6e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:48 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:48 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:48 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Deleted volume successfully. Aug 25 07:02:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2fa6af2f-83a4-4b9f-b9b6-f15d6d4fd7d1 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-745b08aa-c8b6-44dd-9223-ba25ca8817db-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Flow 'volume_create_manager' (e6c1e33c-59e4-41fb-954a-2905fef60ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f36d6d9-8630-431c-b2b3-27ff6ddfd7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f36d6d9-8630-431c-b2b3-27ff6ddfd7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1733124902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088df963-1b3d-400e-ac53-daea6d921bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72adbe120f7b4949bfe634a0639da8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:49Z,use_quota=True,user_id='b1701eb522c24f03a0b5f84a93b2cfad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f8a746-d82a-4c1b-8787-5125b8285935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f8a746-d82a-4c1b-8787-5125b8285935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c31b7e-a2e7-4ed6-b3fd-376cd6aa1b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c31b7e-a2e7-4ed6-b3fd-376cd6aa1b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '088df963-1b3d-400e-ac53-daea6d921bbc', 'volume_name': 'volume-088df963-1b3d-400e-ac53-daea6d921bbc', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00262dc-2e19-4b1a-8c6d-b155928397e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00262dc-2e19-4b1a-8c6d-b155928397e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c49f8a8-179c-442e-867a-0294ed1bca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Volume 088df963-1b3d-400e-ac53-daea6d921bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-088df963-1b3d-400e-ac53-daea6d921bbc', 'volume_size': 1} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1733124902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088df963-1b3d-400e-ac53-daea6d921bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72adbe120f7b4949bfe634a0639da8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:49Z,use_quota=True,user_id='b1701eb522c24f03a0b5f84a93b2cfad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Creating volume 088df963-1b3d-400e-ac53-daea6d921bbc {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:49 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:49 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc 1073741824 Aug 25 07:02:49 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (587dc085-4099-40ea-b67a-7d3be13fe15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68faa0cc-ae27-43f9-a7b6-46eb450d40e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68faa0cc-ae27-43f9-a7b6-46eb450d40e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1709166080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5285a7-ae5b-411d-bef1-33497284901d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:49Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537052cc-2bdc-4508-b338-07bb5dd4a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537052cc-2bdc-4508-b338-07bb5dd4a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55dbed5-d906-4bc3-bd38-77207ba81cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55dbed5-d906-4bc3-bd38-77207ba81cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5285a7-ae5b-411d-bef1-33497284901d', 'volume_name': 'volume-8d5285a7-ae5b-411d-bef1-33497284901d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742b34fe-f395-43c9-a2a2-a365ead709db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742b34fe-f395-43c9-a2a2-a365ead709db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1161f2-9e9d-4541-9f8c-488eeeb80755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Volume 8d5285a7-ae5b-411d-bef1-33497284901d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5285a7-ae5b-411d-bef1-33497284901d', 'volume_size': 1} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:49 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc 1073741824" returned: 0 in 0.400s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:49 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc Aug 25 07:02:49 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:49 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc" returned: 0 in 0.227s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1709166080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5285a7-ae5b-411d-bef1-33497284901d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:49Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Creating volume 8d5285a7-ae5b-411d-bef1-33497284901d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:49 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c49f8a8-179c-442e-867a-0294ed1bca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-088df963-1b3d-400e-ac53-daea6d921bbc', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:50 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d 1073741824 Aug 25 07:02:50 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8729a7-8ab5-4b0d-a2af-c4a39ca0ec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Volume volume-088df963-1b3d-400e-ac53-daea6d921bbc (088df963-1b3d-400e-ac53-daea6d921bbc): created successfully Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8729a7-8ab5-4b0d-a2af-c4a39ca0ec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Flow 'volume_create_manager' (e6c1e33c-59e4-41fb-954a-2905fef60ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-70728583-9566-4098-87cd-e1d86afe10e8 tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Created volume successfully. Aug 25 07:02:50 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d 1073741824" returned: 0 in 0.467s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:50 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d Aug 25 07:02:50 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:50 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1161f2-9e9d-4541-9f8c-488eeeb80755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5285a7-ae5b-411d-bef1-33497284901d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a1ce58-eb2b-4c20-98fd-ab5644579b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Volume volume-8d5285a7-ae5b-411d-bef1-33497284901d (8d5285a7-ae5b-411d-bef1-33497284901d): created successfully Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a1ce58-eb2b-4c20-98fd-ab5644579b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (587dc085-4099-40ea-b67a-7d3be13fe15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8770053b-e12b-435a-a390-c007b3e16828 tempest-VolumesActionsTest-1054953301 None] Created volume successfully. Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-8fbb212d-7d3a-4a58-9deb-d8c7137f7670 req-4cb0ec1e-2823-4ec0-9dd0-47d5c6e2832a tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-8fbb212d-7d3a-4a58-9deb-d8c7137f7670 req-4cb0ec1e-2823-4ec0-9dd0-47d5c6e2832a tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-8fbb212d-7d3a-4a58-9deb-d8c7137f7670 req-4cb0ec1e-2823-4ec0-9dd0-47d5c6e2832a tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-8fbb212d-7d3a-4a58-9deb-d8c7137f7670 req-4cb0ec1e-2823-4ec0-9dd0-47d5c6e2832a tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-088df963-1b3d-400e-ac53-daea6d921bbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dec0b113-55df-486c-af22-dda5bfcfa482', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:02:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-8fbb212d-7d3a-4a58-9deb-d8c7137f7670 req-4cb0ec1e-2823-4ec0-9dd0-47d5c6e2832a tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] attachment_update completed successfully. Aug 25 07:02:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-8d5285a7-ae5b-411d-bef1-33497284901d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-8d5285a7-ae5b-411d-bef1-33497284901d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-quobyte-8d5285a7-ae5b-411d-bef1-33497284901d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-8d5285a7-ae5b-411d-bef1-33497284901d" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[356d0cf7-68a2-4119-a870-4fcac3ae4034]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:52 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d Aug 25 07:02:52 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:52 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:52 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d Aug 25 07:02:52 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:52 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d5285a7-ae5b-411d-bef1-33497284901d" returned: 0 in 0.257s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-8d5285a7-ae5b-411d-bef1-33497284901d" released by "delete_volume" :: held 0.639s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:52 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Created reservations ['06a6a0c9-f401-45a9-afee-91440585b9ad', '5613d7fa-dcc7-4f5e-b128-dff0acedf92e', '4ce3dba1-2afe-4760-91d8-dc6bea8608f8', '272bcec7-5616-4485-a6e6-19fbb89da11c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:53 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:53 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:53 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Deleted volume successfully. Aug 25 07:02:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-aaf7bc21-1a94-4867-94f3-9cfd01d6a669 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-8d5285a7-ae5b-411d-bef1-33497284901d-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-c128c5c0-3704-4c39-a6b1-1c1f8acbe3e8 req-58ef0a94-6baa-4316-8c7e-ca4a5cf38bcb tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Terminate volume connection completed successfully. Aug 25 07:02:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-c128c5c0-3704-4c39-a6b1-1c1f8acbe3e8 req-58ef0a94-6baa-4316-8c7e-ca4a5cf38bcb tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Deleting attachment dec0b113-55df-486c-af22-dda5bfcfa482. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (033665b2-50aa-4b0f-93e7-df86675d3eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0084b65d-c6b4-43eb-901c-bd38394dfe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0084b65d-c6b4-43eb-901c-bd38394dfe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-792270803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870a525a-20a0-470d-a602-1ad910db2155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:55Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1644f1-cd2e-4b19-ac7e-88c1a293fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1644f1-cd2e-4b19-ac7e-88c1a293fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c94b85e-f1da-4a3a-aa0f-8f3353d8b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c94b85e-f1da-4a3a-aa0f-8f3353d8b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870a525a-20a0-470d-a602-1ad910db2155', 'volume_name': 'volume-870a525a-20a0-470d-a602-1ad910db2155', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92232fd-a1ee-442b-948d-77ac71a3b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92232fd-a1ee-442b-948d-77ac71a3b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41777cdf-6505-401f-92d3-7f6c70320757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Volume 870a525a-20a0-470d-a602-1ad910db2155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870a525a-20a0-470d-a602-1ad910db2155', 'volume_size': 1} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-792270803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870a525a-20a0-470d-a602-1ad910db2155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:55Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Creating volume 870a525a-20a0-470d-a602-1ad910db2155 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:55 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:55 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 1073741824 Aug 25 07:02:55 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Acquiring lock "cinder-088df963-1b3d-400e-ac53-daea6d921bbc-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "cinder-088df963-1b3d-400e-ac53-daea6d921bbc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Acquiring lock "cinder-quobyte-088df963-1b3d-400e-ac53-daea6d921bbc" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "cinder-quobyte-088df963-1b3d-400e-ac53-daea6d921bbc" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d078ab5-5b21-4631-9d35-2996012aff42]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:55 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 1073741824" returned: 0 in 0.424s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:55 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc Aug 25 07:02:55 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:56 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 Aug 25 07:02:56 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:56 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc" returned: 0 in 0.356s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:56 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc Aug 25 07:02:56 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:56 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41777cdf-6505-401f-92d3-7f6c70320757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870a525a-20a0-470d-a602-1ad910db2155', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1e2978-4cc5-4569-8b82-4ddd02c205e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:56 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-088df963-1b3d-400e-ac53-daea6d921bbc" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "cinder-quobyte-088df963-1b3d-400e-ac53-daea6d921bbc" released by "delete_volume" :: held 0.644s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:56 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Volume volume-870a525a-20a0-470d-a602-1ad910db2155 (870a525a-20a0-470d-a602-1ad910db2155): created successfully Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1e2978-4cc5-4569-8b82-4ddd02c205e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (033665b2-50aa-4b0f-93e7-df86675d3eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1eff48dc-e842-4f4d-adb3-18eb91583d55 tempest-VolumesActionsTest-1054953301 None] Created volume successfully. Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Created reservations ['f8637877-6129-41eb-8bd4-c05738dfadbf', '8d7822a2-3964-4df0-a7c9-503daf31e3fa', '9a1276fa-44df-431d-8af8-c33074af4052', 'ac30dec5-82b9-4180-a58f-81005738c85d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:56 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:56 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:57 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Deleted volume successfully. Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4f058f1b-5200-4f3d-b32e-feb72234c27d tempest-TestServerVolumeAttachScenarioOldVersion-1042011437 None] Lock "cinder-088df963-1b3d-400e-ac53-daea6d921bbc-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-870a525a-20a0-470d-a602-1ad910db2155-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-870a525a-20a0-470d-a602-1ad910db2155-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-quobyte-870a525a-20a0-470d-a602-1ad910db2155" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-870a525a-20a0-470d-a602-1ad910db2155" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[36806b48-7d3d-45d1-85f6-a01c153af517]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:02:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:57 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 Aug 25 07:02:57 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:58 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155" returned: 0 in 0.493s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:58 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155 Aug 25 07:02:58 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:58 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-870a525a-20a0-470d-a602-1ad910db2155" returned: 0 in 0.267s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-870a525a-20a0-470d-a602-1ad910db2155" released by "delete_volume" :: held 0.804s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Created reservations ['bda80569-ea54-4703-a390-861a28405870', '8927394b-ffe2-4c2e-a5ea-9259c8b5c816', '8747e385-699b-4f04-9185-4994e1fbcb5d', '36ea20b3-d633-4190-a5a5-5f2ad971686c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:58 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:02:58 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:58 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.295s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:02:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Deleted volume successfully. Aug 25 07:02:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-04047a68-1ec8-42a3-bb83-015398601e43 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-870a525a-20a0-470d-a602-1ad910db2155-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (33e229a6-8d03-4d66-90b1-f060dacec078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2597d946-bce5-4b68-8e20-210e8f533d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2597d946-bce5-4b68-8e20-210e8f533d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226993238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579b8463-9c78-4983-9c46-82e24291fe16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:59Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc07251f-cbca-4ab7-925b-83f272e5fbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc07251f-cbca-4ab7-925b-83f272e5fbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869d024a-543d-489c-bb80-449d73bdedf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869d024a-543d-489c-bb80-449d73bdedf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579b8463-9c78-4983-9c46-82e24291fe16', 'volume_name': 'volume-579b8463-9c78-4983-9c46-82e24291fe16', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf17786b-5fd1-4a88-a60d-41bf33fbd500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf17786b-5fd1-4a88-a60d-41bf33fbd500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f072697-f302-40d5-9af1-890a9ec9114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:02:59 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Volume 579b8463-9c78-4983-9c46-82e24291fe16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579b8463-9c78-4983-9c46-82e24291fe16', 'volume_size': 1} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226993238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579b8463-9c78-4983-9c46-82e24291fe16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:02:59Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Creating volume 579b8463-9c78-4983-9c46-82e24291fe16 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:02:59 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:59 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 1073741824 Aug 25 07:02:59 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:02:59 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 1073741824" returned: 0 in 0.468s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:02:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:02:59 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 Aug 25 07:02:59 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:00 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f072697-f302-40d5-9af1-890a9ec9114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579b8463-9c78-4983-9c46-82e24291fe16', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a47ff9-edac-41cb-8e9b-44409a82840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:00 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Volume volume-579b8463-9c78-4983-9c46-82e24291fe16 (579b8463-9c78-4983-9c46-82e24291fe16): created successfully Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a47ff9-edac-41cb-8e9b-44409a82840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (33e229a6-8d03-4d66-90b1-f060dacec078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bba935a7-69d4-480f-b57b-dc06cff7d788 tempest-VolumesActionsTest-1054953301 None] Created volume successfully. Aug 25 07:03:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-579b8463-9c78-4983-9c46-82e24291fe16-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-579b8463-9c78-4983-9c46-82e24291fe16-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "cinder-quobyte-579b8463-9c78-4983-9c46-82e24291fe16" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-579b8463-9c78-4983-9c46-82e24291fe16" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f42c607-166b-404e-809e-132535bf36dc]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:01 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 Aug 25 07:03:01 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:02 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16" returned: 0 in 0.378s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:02 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16 Aug 25 07:03:02 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:02 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-579b8463-9c78-4983-9c46-82e24291fe16" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-quobyte-579b8463-9c78-4983-9c46-82e24291fe16" released by "delete_volume" :: held 0.652s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Created reservations ['d08d898b-ed61-43b2-a578-032d1c0e8ec6', 'ebead1e7-c5c7-438b-8086-102cdb58f6b4', '0c661b6e-d54a-44d4-8137-ba1269c5ba22', 'bed2ac51-649a-4dfc-a5c2-e9e6975c5862'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:02 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:02 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:02 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Deleted volume successfully. Aug 25 07:03:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8f7de013-c80c-46c4-bf10-8409b11c3242 tempest-VolumesActionsTest-1255973205 None] Lock "cinder-579b8463-9c78-4983-9c46-82e24291fe16-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (2c8c7162-74e8-48a9-85ea-619c0af5aad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22418779-3f3e-4875-b3e8-2e3bac825885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22418779-3f3e-4875-b3e8-2e3bac825885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071406046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4d0736-b550-429c-8329-d18fdaaa786c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:03Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ed4be2-a4ce-4d8f-a85e-1f3ff6613d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ed4be2-a4ce-4d8f-a85e-1f3ff6613d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14db997-329d-4d94-b5b6-ceb291d991cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14db997-329d-4d94-b5b6-ceb291d991cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4d0736-b550-429c-8329-d18fdaaa786c', 'volume_name': 'volume-1c4d0736-b550-429c-8329-d18fdaaa786c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8d146d-268e-43b8-83eb-94f26f96a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8d146d-268e-43b8-83eb-94f26f96a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5560af15-8674-4925-9e35-2b2d197dbbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:03 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Volume 1c4d0736-b550-429c-8329-d18fdaaa786c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4d0736-b550-429c-8329-d18fdaaa786c', 'volume_size': 1} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071406046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4d0736-b550-429c-8329-d18fdaaa786c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6f6c4159c45ffa6a49a49f743554c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:03Z,use_quota=True,user_id='ec48741ad2ec436a99c8c59bd4100c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Creating volume 1c4d0736-b550-429c-8329-d18fdaaa786c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:03 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:03 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c 1073741824 Aug 25 07:03:03 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:03 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c 1073741824" returned: 0 in 0.424s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:03 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c Aug 25 07:03:03 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:04 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c" returned: 0 in 0.254s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5560af15-8674-4925-9e35-2b2d197dbbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4d0736-b550-429c-8329-d18fdaaa786c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ef0f25-4c8f-4c1d-af37-6780f21e8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Volume volume-1c4d0736-b550-429c-8329-d18fdaaa786c (1c4d0736-b550-429c-8329-d18fdaaa786c): created successfully Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ef0f25-4c8f-4c1d-af37-6780f21e8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Flow 'volume_create_manager' (2c8c7162-74e8-48a9-85ea-619c0af5aad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0c638b19-de6a-4b6b-9dc0-60580356c9df tempest-VolumesActionsTest-1054953301 None] Created volume successfully. Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "cinder-1c4d0736-b550-429c-8329-d18fdaaa786c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-1c4d0736-b550-429c-8329-d18fdaaa786c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "cinder-quobyte-1c4d0736-b550-429c-8329-d18fdaaa786c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-quobyte-1c4d0736-b550-429c-8329-d18fdaaa786c" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c12506-1eb9-423f-b7aa-a6218db72da8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:05 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c Aug 25 07:03:05 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:05 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c" returned: 0 in 0.356s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:05 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c Aug 25 07:03:05 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:05 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1c4d0736-b550-429c-8329-d18fdaaa786c" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-quobyte-1c4d0736-b550-429c-8329-d18fdaaa786c" released by "delete_volume" :: held 0.650s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Created reservations ['54e82e8d-577b-4d55-a022-96476f8c55ce', '6687827f-7984-49b1-87c2-21fd107f4708', 'd7a4688a-0531-4208-8d38-e1e5fd2a8ae1', '9086d19a-148c-4ed5-b875-1fdb65df49ab'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:05 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:05 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:06 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.269s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:06 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Deleted volume successfully. Aug 25 07:03:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c4d75bec-11c1-42a5-86d5-25b8ef6fca86 tempest-VolumesActionsTest-1054953301 None] Lock "cinder-1c4d0736-b550-429c-8329-d18fdaaa786c-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:15 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=84,cinder:SELECT=73,cinder:DELETE=8,cinder:INSERT=18 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:03:16 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=56,cinder:UPDATE=81,cinder:INSERT=19,cinder:DELETE=6 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Flow 'volume_create_manager' (14a57688-71ea-4747-bd4c-54f7475249f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72e43ed-637b-43fb-abe7-e64e4b58c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72e43ed-637b-43fb-abe7-e64e4b58c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-412895905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91307f52-b242-4fb8-8f22-86f307be918b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d95a2776e740e6aab9a57bc35c9f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:18Z,use_quota=True,user_id='37cf18e532af47649b65441cef1fb0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e097a1-5f46-4f25-9126-e63520b80bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e097a1-5f46-4f25-9126-e63520b80bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e590572c-9307-4fc0-8059-3e55509a247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e590572c-9307-4fc0-8059-3e55509a247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91307f52-b242-4fb8-8f22-86f307be918b', 'volume_name': 'volume-91307f52-b242-4fb8-8f22-86f307be918b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc8a39e-7fff-4eae-9b3f-b339802cc9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc8a39e-7fff-4eae-9b3f-b339802cc9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b935dbf6-80db-4e8a-a508-87a59d877d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Volume 91307f52-b242-4fb8-8f22-86f307be918b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91307f52-b242-4fb8-8f22-86f307be918b', 'volume_size': 1} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-412895905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91307f52-b242-4fb8-8f22-86f307be918b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d95a2776e740e6aab9a57bc35c9f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:18Z,use_quota=True,user_id='37cf18e532af47649b65441cef1fb0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Creating volume 91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:18 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:18 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b 1073741824 Aug 25 07:03:18 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:18 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b 1073741824" returned: 0 in 0.481s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:18 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b Aug 25 07:03:18 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:19 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b" returned: 0 in 0.247s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b935dbf6-80db-4e8a-a508-87a59d877d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91307f52-b242-4fb8-8f22-86f307be918b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a4a73-ebad-4b50-9e7d-a2df762eb10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Volume volume-91307f52-b242-4fb8-8f22-86f307be918b (91307f52-b242-4fb8-8f22-86f307be918b): created successfully Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a4a73-ebad-4b50-9e7d-a2df762eb10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Flow 'volume_create_manager' (14a57688-71ea-4747-bd4c-54f7475249f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-17a91c93-ca9e-4a5f-b2d6-92d23eaaac82 tempest-SnapshotMetadataTestJSON-1541937003 None] Created volume successfully. Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Creating offline snapshot 6387300a-cd97-45ee-a015-5671a5b59c34 of volume 91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9929c97-2fe7-45b1-90cd-d61848f6981f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:20 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b Aug 25 07:03:20 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:20 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b" returned: 0 in 0.375s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:20 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 1G Aug 25 07:03:20 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:21 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 1G" returned: 0 in 0.399s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91307f52-b242-4fb8-8f22-86f307be918b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:21 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91307f52-b242-4fb8-8f22-86f307be918b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 Aug 25 07:03:21 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:21 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91307f52-b242-4fb8-8f22-86f307be918b -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:21 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 is being set with open permissions: ugo+rw Aug 25 07:03:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:21 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 Aug 25 07:03:21 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:21 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:21 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info Aug 25 07:03:21 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:22 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:22 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info is being set with open permissions: ugo+rw Aug 25 07:03:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:22 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info Aug 25 07:03:22 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:22 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.info" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5d5ee519-2979-4aaf-ac84-0bc34166d876 tempest-SnapshotMetadataTestJSON-1541937003 None] Create snapshot completed successfully Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "cinder-6387300a-cd97-45ee-a015-5671a5b59c34-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-6387300a-cd97-45ee-a015-5671a5b59c34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "cinder-quobyte-91307f52-b242-4fb8-8f22-86f307be918b" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-quobyte-91307f52-b242-4fb8-8f22-86f307be918b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "cinder-quobyte-6387300a-cd97-45ee-a015-5671a5b59c34" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-quobyte-6387300a-cd97-45ee-a015-5671a5b59c34" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Deleting offline snapshot 6387300a-cd97-45ee-a015-5671a5b59c34 of volume 91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] snapshot_file for this snap is: volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[37751aff-6295-457b-892a-ccb7b2331385]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:23 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 Aug 25 07:03:23 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:23 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34" returned: 0 in 0.381s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91307f52-b242-4fb8-8f22-86f307be918b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455b5ef-e5b7-4e74-b441-5c42e371b156]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:23 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b Aug 25 07:03:23 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:24 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:24 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 Aug 25 07:03:24 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:24 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34" returned: 0 in 0.358s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:24 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34 Aug 25 07:03:24 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:24 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b.6387300a-cd97-45ee-a015-5671a5b59c34" returned: 0 in 0.286s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-quobyte-6387300a-cd97-45ee-a015-5671a5b59c34" released by "_delete_snapshot" :: held 1.527s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-quobyte-91307f52-b242-4fb8-8f22-86f307be918b" released by "delete_snapshot" :: held 1.552s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:24 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Created reservations ['dc1eb41f-2a9c-4e78-bf42-b8f91a020fc6', 'b2cc586a-0949-4043-8eed-547e509fa605', 'a5eff914-c144-4b13-aad3-223754a2a4d7', '19edf72d-511e-42d0-b72e-849993e833e3'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Delete snapshot completed successfully. Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-75beb738-70fe-47b1-bd6a-241cc37846d8 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-6387300a-cd97-45ee-a015-5671a5b59c34-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "cinder-91307f52-b242-4fb8-8f22-86f307be918b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-91307f52-b242-4fb8-8f22-86f307be918b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "cinder-quobyte-91307f52-b242-4fb8-8f22-86f307be918b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-quobyte-91307f52-b242-4fb8-8f22-86f307be918b" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d91fb71-04d1-4908-8ae0-08fe42ffcf34]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:25 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b Aug 25 07:03:25 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:26 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b" returned: 0 in 0.378s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:26 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b Aug 25 07:03:26 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:26 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-91307f52-b242-4fb8-8f22-86f307be918b" returned: 0 in 0.253s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-quobyte-91307f52-b242-4fb8-8f22-86f307be918b" released by "delete_volume" :: held 0.718s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Created reservations ['4434465a-4ade-47a9-9329-5a94290058ce', '2aae6cbc-843f-4b2f-aea7-756aba553a3e', 'b64ed8ea-ecaf-4ee8-94aa-0edbaa03c954', 'fce1cad4-1197-4036-a4a8-487c4009056d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:26 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:26 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:26 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Deleted volume successfully. Aug 25 07:03:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-745a6ad0-a980-47f4-aa49-666dba663da4 tempest-SnapshotMetadataTestJSON-1541937003 None] Lock "cinder-91307f52-b242-4fb8-8f22-86f307be918b-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (949b9a09-9345-43dc-be4f-eb7b561bfbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304206dd-42f3-4688-9d9b-805494f44b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304206dd-42f3-4688-9d9b-805494f44b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342286576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9deba5fe-dfda-4d4e-a163-645d1d4fef63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:30Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed673305-57e7-46fd-87ae-0ae36d69fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed673305-57e7-46fd-87ae-0ae36d69fd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2c3c27-4834-424b-ac33-09ced26dcea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2c3c27-4834-424b-ac33-09ced26dcea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9deba5fe-dfda-4d4e-a163-645d1d4fef63', 'volume_name': 'volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd46c32-40e2-4f2f-b3ed-e954cdb3915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd46c32-40e2-4f2f-b3ed-e954cdb3915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4174a501-7410-4e54-86a3-19ae6746809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:29 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Volume 9deba5fe-dfda-4d4e-a163-645d1d4fef63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63', 'volume_size': 1} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342286576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9deba5fe-dfda-4d4e-a163-645d1d4fef63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:30Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Creating volume 9deba5fe-dfda-4d4e-a163-645d1d4fef63 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:29 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:29 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 1073741824 Aug 25 07:03:29 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:30 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 1073741824" returned: 0 in 0.552s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:30 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 Aug 25 07:03:30 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:30 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63" returned: 0 in 0.307s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4174a501-7410-4e54-86a3-19ae6746809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340f9b4c-4a2f-4fa9-866e-62169dbd9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:30 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Volume volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 (9deba5fe-dfda-4d4e-a163-645d1d4fef63): created successfully Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340f9b4c-4a2f-4fa9-866e-62169dbd9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (949b9a09-9345-43dc-be4f-eb7b561bfbed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3cb53861-0859-4981-a1f6-6f2e21f440bc tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:31 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:31 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:32 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.348s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (4fa6ddaa-e391-4df8-8668-ead69f5d2b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1167674-7a0c-46ae-a851-b6e9a7a4218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1167674-7a0c-46ae-a851-b6e9a7a4218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-300012430',display_name='tempest-VolumesGetTest-Volume-2054935418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de7d315-c480-4971-ac9f-4625d33db1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:33Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e08c707-c4cd-487d-9a25-7401b36c0431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e08c707-c4cd-487d-9a25-7401b36c0431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b482a36d-3f15-4b7a-847e-d8ce9e221739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b482a36d-3f15-4b7a-847e-d8ce9e221739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de7d315-c480-4971-ac9f-4625d33db1ac', 'volume_name': 'volume-0de7d315-c480-4971-ac9f-4625d33db1ac', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a60590-4c0d-4f55-9ee9-748ef6da8947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a60590-4c0d-4f55-9ee9-748ef6da8947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d058326-a02b-4a10-8c77-924835623724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:32 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Volume 0de7d315-c480-4971-ac9f-4625d33db1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de7d315-c480-4971-ac9f-4625d33db1ac', 'volume_size': 1} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-300012430',display_name='tempest-VolumesGetTest-Volume-2054935418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de7d315-c480-4971-ac9f-4625d33db1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:33Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Creating volume 0de7d315-c480-4971-ac9f-4625d33db1ac {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:32 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:32 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac 1073741824 Aug 25 07:03:32 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:33 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac 1073741824" returned: 0 in 0.462s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:33 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac Aug 25 07:03:33 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:33 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac" returned: 0 in 0.296s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d058326-a02b-4a10-8c77-924835623724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de7d315-c480-4971-ac9f-4625d33db1ac', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec0c94b-e378-41a8-9929-d7754131521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:33 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Volume volume-0de7d315-c480-4971-ac9f-4625d33db1ac (0de7d315-c480-4971-ac9f-4625d33db1ac): created successfully Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec0c94b-e378-41a8-9929-d7754131521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (4fa6ddaa-e391-4df8-8668-ead69f5d2b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:33 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b1750cda-826b-4a81-b760-ee9e1605d6f2 tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-0de7d315-c480-4971-ac9f-4625d33db1ac-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Lock "cinder-0de7d315-c480-4971-ac9f-4625d33db1ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-0de7d315-c480-4971-ac9f-4625d33db1ac" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-0de7d315-c480-4971-ac9f-4625d33db1ac" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff83127c-a25d-4d8b-aa1c-ccf1907ff14a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:35 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac Aug 25 07:03:35 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:35 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac" returned: 0 in 0.400s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:35 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac Aug 25 07:03:35 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:35 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0de7d315-c480-4971-ac9f-4625d33db1ac" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-0de7d315-c480-4971-ac9f-4625d33db1ac" released by "delete_volume" :: held 0.687s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Created reservations ['455a6693-b8dc-48f0-b468-b62363eabd67', 'b7898ffa-5cff-4103-8c73-025786afb90f', 'a09b5426-24b6-4906-a867-a103c3864e8b', 'f4767277-cc29-4920-9d16-c296d42926ff'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:36 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:36 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Flow 'volume_create_manager' (2d16aa69-4ff0-4b9b-ab70-4daecfadd4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418479b9-d1a5-4b45-ada2-10caca09cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:36 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.254s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418479b9-d1a5-4b45-ada2-10caca09cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2062868631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552f51cd-9528-4adc-8d12-5c4d4ee95329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33127e2ddd446f29e5456577fc0a8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:36Z,use_quota=True,user_id='d0bcea4b78c84b9eb176786337aa8fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1249394-3804-4de5-98a9-658f0bcff982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1249394-3804-4de5-98a9-658f0bcff982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72280e9-1f70-476a-88f3-a7e83c5ed3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:03:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-9deba5fe-dfda-4d4e-a163-645d1d4fef63-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3be4b615-33dd-47a8-b778-d75a53d4b5ee tempest-VolumesGetTest-960635141 None] Lock "cinder-0de7d315-c480-4971-ac9f-4625d33db1ac-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Lock "cinder-9deba5fe-dfda-4d4e-a163-645d1d4fef63-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-9deba5fe-dfda-4d4e-a163-645d1d4fef63" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-9deba5fe-dfda-4d4e-a163-645d1d4fef63" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a95f4b9-2818-4a4c-ae08-fb49201889a7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:36 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 Aug 25 07:03:36 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72280e9-1f70-476a-88f3-a7e83c5ed3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '552f51cd-9528-4adc-8d12-5c4d4ee95329', 'volume_name': 'volume-552f51cd-9528-4adc-8d12-5c4d4ee95329', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e81821-eb4a-4ff2-a5ad-ec4eba5441fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e81821-eb4a-4ff2-a5ad-ec4eba5441fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6adfb71-2f5b-4f55-acf9-af71aa128f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Volume 552f51cd-9528-4adc-8d12-5c4d4ee95329: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-552f51cd-9528-4adc-8d12-5c4d4ee95329', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Trying to clone 552f51cd-9528-4adc-8d12-5c4d4ee95329 from image d970149c-5c62-44a8-b2c8-06c24c805604 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:03:36 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63" returned: 0 in 0.422s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:36 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63 Aug 25 07:03:36 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:36 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:03:36 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Image download 20.69 MB at 20.69 MB/s Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[419dc9b3-ecbe-41a1-baed-22de74badbdf]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:37 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9deba5fe-dfda-4d4e-a163-645d1d4fef63" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:37 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD Aug 25 07:03:37 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-9deba5fe-dfda-4d4e-a163-645d1d4fef63" released by "delete_volume" :: held 0.737s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Created reservations ['e7d41780-37e1-4b28-a45f-5a124d1b2be3', '3ca038a0-1398-4926-a8ca-5e1acb57c297', '9442db6a-ebcc-4c48-a2fd-045eff0be5ef', '9869b1bf-f59c-4726-990f-21badfc33e16'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:37 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:37 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:37 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 is fetched for user d0bcea4b78c84b9eb176786337aa8fac. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2733e2ab-a0c4-47c1-8064-b0aa17e6f0dc]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:37 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.250s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1f22af65-401c-46ac-81ff-e947b43891f0 tempest-VolumesGetTest-960635141 None] Lock "cinder-9deba5fe-dfda-4d4e-a163-645d1d4fef63-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:37 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD Aug 25 07:03:37 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:37 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2062868631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552f51cd-9528-4adc-8d12-5c4d4ee95329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33127e2ddd446f29e5456577fc0a8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:36Z,use_quota=True,user_id='d0bcea4b78c84b9eb176786337aa8fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Creating volume 552f51cd-9528-4adc-8d12-5c4d4ee95329 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:37 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:37 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 1073741824 Aug 25 07:03:37 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (afd26e80-3045-4f87-bb4f-e7406cfc70d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281878cb-39e4-4cbc-9983-fe8fae437f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281878cb-39e4-4cbc-9983-fe8fae437f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1798728098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d023674-e5b6-4178-aa0c-a1ed50175342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:38Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c53282d-e7a3-4d30-8e17-b7e7316dcf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c53282d-e7a3-4d30-8e17-b7e7316dcf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143b6611-a3c3-4efc-bc5f-ee60c3f26602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143b6611-a3c3-4efc-bc5f-ee60c3f26602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d023674-e5b6-4178-aa0c-a1ed50175342', 'volume_name': 'volume-1d023674-e5b6-4178-aa0c-a1ed50175342', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15692a06-40e5-4f28-aeec-5b383cfcfcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15692a06-40e5-4f28-aeec-5b383cfcfcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c47685b-3b83-451d-9bc1-4e2f88ab7f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:38 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Volume 1d023674-e5b6-4178-aa0c-a1ed50175342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d023674-e5b6-4178-aa0c-a1ed50175342', 'volume_size': 1} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:38 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 1073741824" returned: 0 in 0.446s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:38 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 Aug 25 07:03:38 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:38 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1798728098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d023674-e5b6-4178-aa0c-a1ed50175342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:38Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Creating volume 1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:38 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:38 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 1073741824 Aug 25 07:03:38 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Attempting download of d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume 552f51cd-9528-4adc-8d12-5c4d4ee95329. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c3f27-3520-4cc4-bc56-2a968434f37c]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:38 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit Aug 25 07:03:38 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:38 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:38 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit" returned: 0 in 0.374s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 1073741824" returned: 0 in 0.464s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:39 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 Aug 25 07:03:39 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:39 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit Aug 25 07:03:39 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:39 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c47685b-3b83-451d-9bc1-4e2f88ab7f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d023674-e5b6-4178-aa0c-a1ed50175342', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f197d9b5-294c-4337-9bd1-a99348fe92fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:39 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit" returned: 1 in 0.350s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_192ehfit' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[edebfe53-940e-4a64-939e-7f6a043c877d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Volume volume-1d023674-e5b6-4178-aa0c-a1ed50175342 (1d023674-e5b6-4178-aa0c-a1ed50175342): created successfully Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f197d9b5-294c-4337-9bd1-a99348fe92fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (afd26e80-3045-4f87-bb4f-e7406cfc70d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-19c5b3b1-2fda-4f8e-a94e-bf21009bf1de tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:03:39 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD Aug 25 07:03:39 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:39 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] d970149c-5c62-44a8-b2c8-06c24c805604 was qcow2, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:03:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:39 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 Aug 25 07:03:39 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (61cd5164-8d0c-4b59-8972-1e29b310b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f9f6b0-8363-4af6-b6e2-b74b3c7e498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f9f6b0-8363-4af6-b6e2-b74b3c7e498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1128293970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4698e7e4-4f73-47cb-a800-dccaa66a35e7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1d023674-e5b6-4178-aa0c-a1ed50175342,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:40Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8811bb7-4a85-4e93-b210-e0d48da9cf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8811bb7-4a85-4e93-b210-e0d48da9cf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148c0e9-e292-4135-99cf-51a1a03cffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148c0e9-e292-4135-99cf-51a1a03cffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4698e7e4-4f73-47cb-a800-dccaa66a35e7', 'volume_name': 'volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7', 'volume_size': 1, 'source_volid': '1d023674-e5b6-4178-aa0c-a1ed50175342', 'source_volstatus': 'available'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef48aa91-9dfa-4ee1-b672-1a7f8f25fa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef48aa91-9dfa-4ee1-b672-1a7f8f25fa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79531fae-9474-435d-87bb-8acacdcd60fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Volume 4698e7e4-4f73-47cb-a800-dccaa66a35e7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7', 'volume_size': 1, 'source_volid': '1d023674-e5b6-4178-aa0c-a1ed50175342', 'source_volstatus': 'available'} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:40 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Cloning volume 1d023674-e5b6-4178-aa0c-a1ed50175342 to volume 4698e7e4-4f73-47cb-a800-dccaa66a35e7 Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Creating offline snapshot 7df2a428-2417-4880-85c5-e98ea36a5a58 of volume 1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5e4cb-208d-487e-9755-73ee16f4c4a5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:40 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 Aug 25 07:03:40 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:41 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342" returned: 0 in 0.374s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:41 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 1G Aug 25 07:03:41 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:41 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329" returned: 0 in 1.668s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_5n8ntm7ldevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:03:41 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Converted 112.00 MB image at 67.08 MB/s Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:41 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 1G Aug 25 07:03:41 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:41 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 1G" returned: 0 in 0.439s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d023674-e5b6-4178-aa0c-a1ed50175342 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:41 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d023674-e5b6-4178-aa0c-a1ed50175342 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 Aug 25 07:03:41 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:41 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 1G" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Downloaded image d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume 552f51cd-9528-4adc-8d12-5c4d4ee95329 successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 for user d0bcea4b78c84b9eb176786337aa8fac is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Marking volume 552f51cd-9528-4adc-8d12-5c4d4ee95329 as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Copying metadata from image d970149c-5c62-44a8-b2c8-06c24c805604 to 552f51cd-9528-4adc-8d12-5c4d4ee95329. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Creating volume glance metadata for volume 552f51cd-9528-4adc-8d12-5c4d4ee95329 backed by image d970149c-5c62-44a8-b2c8-06c24c805604 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6adfb71-2f5b-4f55-acf9-af71aa128f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552f51cd-9528-4adc-8d12-5c4d4ee95329', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909f41df-a5a5-409f-990b-fdc328b4ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Volume volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 (552f51cd-9528-4adc-8d12-5c4d4ee95329): created successfully Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909f41df-a5a5-409f-990b-fdc328b4ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Flow 'volume_create_manager' (2d16aa69-4ff0-4b9b-ab70-4daecfadd4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-67cece76-5831-470b-b7e0-b2e455fc41f0 tempest-TestShelveInstance-1700852723 None] Created volume successfully. Aug 25 07:03:41 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d023674-e5b6-4178-aa0c-a1ed50175342 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:41 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 is being set with open permissions: ugo+rw Aug 25 07:03:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:41 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 Aug 25 07:03:41 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:42 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58" returned: 0 in 0.241s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:42 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info Aug 25 07:03:42 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:42 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info" returned: 0 in 0.243s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:42 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info is being set with open permissions: ugo+rw Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:42 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info Aug 25 07:03:42 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:42 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.info" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-4698e7e4-4f73-47cb-a800-dccaa66a35e7" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-4698e7e4-4f73-47cb-a800-dccaa66a35e7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] snapshot: 7df2a428-2417-4880-85c5-e98ea36a5a58, volume: 4698e7e4-4f73-47cb-a800-dccaa66a35e7, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c0cc20-2132-4b23-b531-31f5ae1cd6a4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:42 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 Aug 25 07:03:42 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:43 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58" returned: 0 in 0.382s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d023674-e5b6-4178-aa0c-a1ed50175342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[462bee95-8509-4c74-ae2d-bb40569eae82]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:43 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 Aug 25 07:03:43 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:43 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342" returned: 0 in 0.405s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:03:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:43 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 Aug 25 07:03:43 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-319d323a-d53c-40c3-a991-50c8d32ebb1f req-addec1e0-2b33-4ba2-a993-c805e621b300 tempest-TestShelveInstance-1700852723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7" returned: 0 in 5.434s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:48 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:03:48 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Converted 1024.00 MB image at 188.39 MB/s Aug 25 07:03:48 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 is being set with open permissions: ugo+rw Aug 25 07:03:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:48 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 Aug 25 07:03:48 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:49 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7" returned: 0 in 0.298s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-4698e7e4-4f73-47cb-a800-dccaa66a35e7" released by "_copy_volume_from_snapshot" :: held 6.599s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-7df2a428-2417-4880-85c5-e98ea36a5a58" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-7df2a428-2417-4880-85c5-e98ea36a5a58" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Deleting offline snapshot 7df2a428-2417-4880-85c5-e98ea36a5a58 of volume 1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] snapshot_file for this snap is: volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8bf1e-9944-470d-b970-659c146fa6c7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:49 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 Aug 25 07:03:49 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:49 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58" returned: 0 in 0.377s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d023674-e5b6-4178-aa0c-a1ed50175342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ff801b-6db6-4258-85da-a49eb6d12f41]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:49 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 Aug 25 07:03:49 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:50 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342" returned: 0 in 0.579s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:50 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 Aug 25 07:03:50 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:50 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:50 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58 Aug 25 07:03:50 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:50 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342.7df2a428-2417-4880-85c5-e98ea36a5a58" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-7df2a428-2417-4880-85c5-e98ea36a5a58" released by "_delete_snapshot" :: held 1.635s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.263s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-319d323a-d53c-40c3-a991-50c8d32ebb1f req-addec1e0-2b33-4ba2-a993-c805e621b300 tempest-TestShelveInstance-1700852723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.928s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-319d323a-d53c-40c3-a991-50c8d32ebb1f req-addec1e0-2b33-4ba2-a993-c805e621b300 tempest-TestShelveInstance-1700852723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79531fae-9474-435d-87bb-8acacdcd60fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7', 'volume_size': 1, 'source_volid': '1d023674-e5b6-4178-aa0c-a1ed50175342', 'source_volstatus': 'available'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b55583c-9225-4d8c-ba82-b949334b3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Volume volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 (4698e7e4-4f73-47cb-a800-dccaa66a35e7): created successfully Aug 25 07:03:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b55583c-9225-4d8c-ba82-b949334b3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (61cd5164-8d0c-4b59-8972-1e29b310b802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-319d323a-d53c-40c3-a991-50c8d32ebb1f req-addec1e0-2b33-4ba2-a993-c805e621b300 tempest-TestShelveInstance-1700852723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-552f51cd-9528-4adc-8d12-5c4d4ee95329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45689cf0-fdaf-4069-b669-d661a451d3bc', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:03:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-97f2d3a3-69ce-47a2-8ca1-bbeca1ed5a72 tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:03:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-319d323a-d53c-40c3-a991-50c8d32ebb1f req-addec1e0-2b33-4ba2-a993-c805e621b300 tempest-TestShelveInstance-1700852723 None] attachment_update completed successfully. Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (993469bd-5cfb-40a9-9910-e471ff10a175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3771155e-f1a3-4eea-a52d-2d129251fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3771155e-f1a3-4eea-a52d-2d129251fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-528463380',display_name='tempest-VolumesGetTest-Volume-1678614110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4cc14b-ab4f-4a04-8f09-297030c8ead0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:53Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ca8e8-07ab-4837-aec1-1e2667671e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ca8e8-07ab-4837-aec1-1e2667671e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a412e37-5cad-47cd-8d5d-824953d0bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a412e37-5cad-47cd-8d5d-824953d0bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4cc14b-ab4f-4a04-8f09-297030c8ead0', 'volume_name': 'volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f186ab00-7d22-4f9c-b596-250bb30b3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f186ab00-7d22-4f9c-b596-250bb30b3070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63491626-bf9d-462e-b820-a71d4865fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:52 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Volume 8d4cc14b-ab4f-4a04-8f09-297030c8ead0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0', 'volume_size': 1} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-528463380',display_name='tempest-VolumesGetTest-Volume-1678614110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4cc14b-ab4f-4a04-8f09-297030c8ead0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:03:53Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Creating volume 8d4cc14b-ab4f-4a04-8f09-297030c8ead0 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:03:52 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:03:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:52 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 1073741824 Aug 25 07:03:52 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:53 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 1073741824" returned: 0 in 0.454s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:53 devstack sudo[110013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 Aug 25 07:03:53 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:53 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63491626-bf9d-462e-b820-a71d4865fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d75931-4955-44a0-b41c-49ebcdacec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Volume volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 (8d4cc14b-ab4f-4a04-8f09-297030c8ead0): created successfully Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d75931-4955-44a0-b41c-49ebcdacec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (993469bd-5cfb-40a9-9910-e471ff10a175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7b5d5680-df5f-40de-9d6e-fbb09670abfa tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-8d4cc14b-ab4f-4a04-8f09-297030c8ead0-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Lock "cinder-8d4cc14b-ab4f-4a04-8f09-297030c8ead0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-8d4cc14b-ab4f-4a04-8f09-297030c8ead0" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-8d4cc14b-ab4f-4a04-8f09-297030c8ead0" acquired by "delete_volume" :: waited 0.039s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0815779-2931-49d0-a2c0-120c32ea8232]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:55 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 Aug 25 07:03:55 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:55 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:55 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0 Aug 25 07:03:55 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:56 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8d4cc14b-ab4f-4a04-8f09-297030c8ead0" returned: 0 in 0.327s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-8d4cc14b-ab4f-4a04-8f09-297030c8ead0" released by "delete_volume" :: held 0.829s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Created reservations ['675d7b43-54a0-4ec6-aa44-3f6fc8957f64', 'b9f50a13-d9ff-42f7-8eb7-18232caa2a47', 'f965cdff-544e-4562-ad14-0c54c1c9e92e', 'b3a33b64-5ca0-4f95-90c9-042624995ec7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:56 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:56 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-4698e7e4-4f73-47cb-a800-dccaa66a35e7-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Lock "cinder-4698e7e4-4f73-47cb-a800-dccaa66a35e7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-4698e7e4-4f73-47cb-a800-dccaa66a35e7" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-4698e7e4-4f73-47cb-a800-dccaa66a35e7" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d30892-01dd-4d3d-a256-76b49fac32a0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:56 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:03:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9415d37-ba24-45bf-95c5-5ff9721a613e tempest-VolumesGetTest-960635141 None] Lock "cinder-8d4cc14b-ab4f-4a04-8f09-297030c8ead0-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:56 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 Aug 25 07:03:56 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:57 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7" returned: 0 in 0.490s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:57 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7 Aug 25 07:03:57 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:57 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-4698e7e4-4f73-47cb-a800-dccaa66a35e7" returned: 0 in 0.305s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-4698e7e4-4f73-47cb-a800-dccaa66a35e7" released by "delete_volume" :: held 0.856s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Created reservations ['ad33046b-9425-4608-955d-a668d9f9d8e0', 'd1b3274d-e5af-4fa8-b344-71e2e88766c6', 'ae5a5814-9acb-4785-a1a0-e1070dea44e5', 'bd8bf22c-3a84-474f-9730-3c4c212b9a66'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:57 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:57 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-1d023674-e5b6-4178-aa0c-a1ed50175342-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Lock "cinder-1d023674-e5b6-4178-aa0c-a1ed50175342-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:57 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.370s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-1d023674-e5b6-4178-aa0c-a1ed50175342" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-1d023674-e5b6-4178-aa0c-a1ed50175342" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-95d1685f-a127-4944-957b-24ae6ece1eb3 tempest-VolumesGetTest-960635141 None] Lock "cinder-4698e7e4-4f73-47cb-a800-dccaa66a35e7-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a2bed3-ee5d-4739-9c3b-40282a21aea0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:03:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:58 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 Aug 25 07:03:58 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:58 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342" returned: 0 in 0.429s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:58 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342 Aug 25 07:03:58 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:58 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1d023674-e5b6-4178-aa0c-a1ed50175342" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-1d023674-e5b6-4178-aa0c-a1ed50175342" released by "delete_volume" :: held 0.781s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Created reservations ['20946f78-8174-4ce1-b567-d32a3729d90f', 'c19d435d-f9b6-4042-abf6-1f94076a0252', 'd6a3fef5-1030-43d5-96fe-114ff032c517', 'd2538c59-0f14-4e9c-b927-9db91f14742d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:03:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:03:58 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:03:58 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:03:59 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:03:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c0b8e06d-57e2-4b73-ab7f-2675e981240a tempest-VolumesGetTest-960635141 None] Lock "cinder-1d023674-e5b6-4178-aa0c-a1ed50175342-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (7bb1ac79-e701-41b6-b18d-77bdf71d9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078fd84d-6606-4987-880e-cce2612ff2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078fd84d-6606-4987-880e-cce2612ff2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1505412473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16488b8-bd78-4206-acca-6e3ae7813e62,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:00Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d9a115-37af-4167-80c0-1b9e28fea6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d9a115-37af-4167-80c0-1b9e28fea6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ceb882a-f22b-4863-9095-42874619ed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:03:59 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ceb882a-f22b-4863-9095-42874619ed73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f16488b8-bd78-4206-acca-6e3ae7813e62', 'volume_name': 'volume-f16488b8-bd78-4206-acca-6e3ae7813e62', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1193f7d0-fe86-40d4-82c7-9d2b3ff36ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1193f7d0-fe86-40d4-82c7-9d2b3ff36ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cce885-b5b3-4373-b01b-fc38d750e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:00 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Volume f16488b8-bd78-4206-acca-6e3ae7813e62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f16488b8-bd78-4206-acca-6e3ae7813e62', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Trying to clone f16488b8-bd78-4206-acca-6e3ae7813e62 from image d970149c-5c62-44a8-b2c8-06c24c805604 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:04:00 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Image download 20.69 MB at 20.69 MB/s Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba5833-cd36-42db-83a4-e53547002dc1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:00 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD Aug 25 07:04:00 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:00 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 is fetched for user a834ecbb848f4f4ca6882a7fdd7670be. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d13d9d-c1d6-4bbf-9bae-0fb16ccb4aad]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:00 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD Aug 25 07:04:00 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:01 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1505412473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16488b8-bd78-4206-acca-6e3ae7813e62,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:00Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Creating volume f16488b8-bd78-4206-acca-6e3ae7813e62 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:01 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:01 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 1073741824 Aug 25 07:04:01 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:01 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 1073741824" returned: 0 in 0.391s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:01 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 Aug 25 07:04:01 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:01 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62" returned: 0 in 0.261s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Attempting download of d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume f16488b8-bd78-4206-acca-6e3ae7813e62. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ecce4-da47-4dae-89d7-b9eadb8709b3]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:02 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d Aug 25 07:04:02 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:02 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d" returned: 0 in 0.336s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:02 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d Aug 25 07:04:02 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:02 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d" returned: 1 in 0.341s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d970149c-5c62-44a8-b2c8-06c24c805604_rcpa190d' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a7dd3-1a3d-4b0a-b271-9be298d75b3d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:02 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD Aug 25 07:04:02 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:02 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] d970149c-5c62-44a8-b2c8-06c24c805604 was qcow2, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:04:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:02 devstack sudo[110090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 Aug 25 07:04:02 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:04 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62" returned: 0 in 1.548s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d970149c-5c62-44a8-b2c8-06c24c805604_0dblmuepdevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:04:04 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Converted 112.00 MB image at 72.28 MB/s Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:04 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 1G Aug 25 07:04:04 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:04 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 1G" returned: 0 in 0.295s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Downloaded image d970149c-5c62-44a8-b2c8-06c24c805604 ((None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}])) to volume f16488b8-bd78-4206-acca-6e3ae7813e62 successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Temporary image d970149c-5c62-44a8-b2c8-06c24c805604 for user a834ecbb848f4f4ca6882a7fdd7670be is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Marking volume f16488b8-bd78-4206-acca-6e3ae7813e62 as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Copying metadata from image d970149c-5c62-44a8-b2c8-06c24c805604 to f16488b8-bd78-4206-acca-6e3ae7813e62. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Creating volume glance metadata for volume f16488b8-bd78-4206-acca-6e3ae7813e62 backed by image d970149c-5c62-44a8-b2c8-06c24c805604 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cce885-b5b3-4373-b01b-fc38d750e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f16488b8-bd78-4206-acca-6e3ae7813e62', 'volume_size': 1, 'image_id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d970149c-5c62-44a8-b2c8-06c24c805604', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4f8395cb7a24313836d7b56ae0cdc8c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd970149c-5c62-44a8-b2c8-06c24c805604', 'created_at': datetime.datetime(2026, 8, 25, 4, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 4, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d970149c-5c62-44a8-b2c8-06c24c805604/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cb7fc0-b111-44f6-9735-f4219bdcc8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Volume volume-f16488b8-bd78-4206-acca-6e3ae7813e62 (f16488b8-bd78-4206-acca-6e3ae7813e62): created successfully Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cb7fc0-b111-44f6-9735-f4219bdcc8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (7bb1ac79-e701-41b6-b18d-77bdf71d9305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-464fc56e-e792-454a-9c43-1f7d55c40ea8 tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (14749964-2075-46cf-9f84-ce5034828b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938b6031-c6da-4fb4-995f-b0fb78ddad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938b6031-c6da-4fb4-995f-b0fb78ddad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-766301916',display_name='tempest-VolumesGetTest-Volume-1996152282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33084945-c49a-4736-a894-d5e0e0e5859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:06Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d834313e-4767-430a-a5eb-e81472feb0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d834313e-4767-430a-a5eb-e81472feb0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f369373b-b4b7-45e4-935c-c1f201f33919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f369373b-b4b7-45e4-935c-c1f201f33919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33084945-c49a-4736-a894-d5e0e0e5859b', 'volume_name': 'volume-33084945-c49a-4736-a894-d5e0e0e5859b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c1daba-0958-40c2-a270-a275b10f2cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c1daba-0958-40c2-a270-a275b10f2cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b3b20-8efc-42dc-b6f1-a313148fb5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:05 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Volume 33084945-c49a-4736-a894-d5e0e0e5859b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33084945-c49a-4736-a894-d5e0e0e5859b', 'volume_size': 1} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-766301916',display_name='tempest-VolumesGetTest-Volume-1996152282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33084945-c49a-4736-a894-d5e0e0e5859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8d8289cae4a10b62ef75bf64e3d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:06Z,use_quota=True,user_id='a834ecbb848f4f4ca6882a7fdd7670be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Creating volume 33084945-c49a-4736-a894-d5e0e0e5859b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:05 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:04:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:05 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b 1073741824 Aug 25 07:04:05 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:06 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b 1073741824" returned: 0 in 0.401s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:06 devstack sudo[110110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b Aug 25 07:04:06 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:06 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b" returned: 0 in 0.240s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b3b20-8efc-42dc-b6f1-a313148fb5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33084945-c49a-4736-a894-d5e0e0e5859b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b764c108-227f-4fbd-b965-539cb7f9885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:06 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Volume volume-33084945-c49a-4736-a894-d5e0e0e5859b (33084945-c49a-4736-a894-d5e0e0e5859b): created successfully Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b764c108-227f-4fbd-b965-539cb7f9885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Flow 'volume_create_manager' (14749964-2075-46cf-9f84-ce5034828b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eb71f223-a378-4725-8ee5-81d11c768a7b tempest-VolumesGetTest-960635141 None] Created volume successfully. Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-33084945-c49a-4736-a894-d5e0e0e5859b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Lock "cinder-33084945-c49a-4736-a894-d5e0e0e5859b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-33084945-c49a-4736-a894-d5e0e0e5859b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-33084945-c49a-4736-a894-d5e0e0e5859b" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a774160f-10f7-48e1-a2e1-a6437f523436]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:07 devstack sudo[110113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b Aug 25 07:04:07 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:07 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b" returned: 0 in 0.346s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:07 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b Aug 25 07:04:07 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:07 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-33084945-c49a-4736-a894-d5e0e0e5859b" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-33084945-c49a-4736-a894-d5e0e0e5859b" released by "delete_volume" :: held 0.637s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Created reservations ['3da7a92b-a03f-4fc1-a731-62875e4832e2', '0d743505-3506-4228-8985-4dd54ae35bf3', 'b058ddfb-7851-4a82-bdf1-3dc0149d5846', 'aba407df-ac58-4850-b353-6bff2a65ccdd'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:07 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:04:07 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:08 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.294s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cec2b7f4-3e20-4792-a035-7e5a51366a96 tempest-VolumesGetTest-960635141 None] Lock "cinder-33084945-c49a-4736-a894-d5e0e0e5859b-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-f16488b8-bd78-4206-acca-6e3ae7813e62-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Lock "cinder-f16488b8-bd78-4206-acca-6e3ae7813e62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Acquiring lock "cinder-quobyte-f16488b8-bd78-4206-acca-6e3ae7813e62" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-f16488b8-bd78-4206-acca-6e3ae7813e62" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90e0e8-06a3-4e20-bccc-28720a0acaff]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:08 devstack sudo[110124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 Aug 25 07:04:08 devstack sudo[110124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:08 devstack sudo[110124]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62" returned: 0 in 0.391s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:08 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62 Aug 25 07:04:08 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:08 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f16488b8-bd78-4206-acca-6e3ae7813e62" returned: 0 in 0.290s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Lock "cinder-quobyte-f16488b8-bd78-4206-acca-6e3ae7813e62" released by "delete_volume" :: held 0.728s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:08 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Created reservations ['7b9a4a3c-e45f-442f-badf-1af3098792d8', '50de9747-ff6b-4013-b23b-e2740cbae0ee', 'd1075d0a-e6ba-4587-8adf-ed9129b152dc', '7472d53d-e7c8-43ac-90d5-dfef43f9958f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:09 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:04:09 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:09 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Deleted volume successfully. Aug 25 07:04:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-57035232-adcc-4791-82f8-642ddec325e3 tempest-VolumesGetTest-960635141 None] Lock "cinder-f16488b8-bd78-4206-acca-6e3ae7813e62-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:19 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=87,cinder:UPDATE=108,cinder:DELETE=10,cinder:INSERT=37 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:04:19 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=100,cinder:SELECT=96,cinder:INSERT=37,cinder:DELETE=8 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:04:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-c0e02594-069c-44be-ae55-5c78c6278f00 req-394cec59-cf02-4f89-b055-4c3372f5ff43 tempest-TestShelveInstance-1700852723 None] Terminate volume connection completed successfully. Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-c0e02594-069c-44be-ae55-5c78c6278f00 req-394cec59-cf02-4f89-b055-4c3372f5ff43 tempest-TestShelveInstance-1700852723 None] Deleting attachment 45689cf0-fdaf-4069-b669-d661a451d3bc. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (e7bfb5e5-4a80-41fc-b479-a036c8880550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f317c3-4499-4587-b208-122e505fbe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f317c3-4499-4587-b208-122e505fbe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-344400249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199a690f-58e8-4111-9b73-b6a61e2bcdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:22Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3290823-b21b-4ee4-be2c-f5612596133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3290823-b21b-4ee4-be2c-f5612596133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9680d16-ffc8-41e6-ac9f-747836c1408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9680d16-ffc8-41e6-ac9f-747836c1408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199a690f-58e8-4111-9b73-b6a61e2bcdeb', 'volume_name': 'volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a5e012-b5af-471a-9b4b-e8117c1fbf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a5e012-b5af-471a-9b4b-e8117c1fbf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7706162c-b9cf-4385-916f-0a5bd607127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Volume 199a690f-58e8-4111-9b73-b6a61e2bcdeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb', 'volume_size': 1} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-344400249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199a690f-58e8-4111-9b73-b6a61e2bcdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:22Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Creating volume 199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:21 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:04:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:21 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb 1073741824 Aug 25 07:04:21 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:22 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb 1073741824" returned: 0 in 0.485s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:22 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb Aug 25 07:04:22 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:22 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7706162c-b9cf-4385-916f-0a5bd607127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4595397-22db-4389-b1ba-f652f6802638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:22 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Volume volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb (199a690f-58e8-4111-9b73-b6a61e2bcdeb): created successfully Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4595397-22db-4389-b1ba-f652f6802638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (e7bfb5e5-4a80-41fc-b479-a036c8880550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-788eba84-be05-413d-a3a9-5ef7d24fe8c0 tempest-VolumesSnapshotTestJSON-553439953 None] Created volume successfully. Aug 25 07:04:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Creating offline snapshot ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 of volume 199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:04:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee999fc3-6776-4126-855a-efa1cfc10f9a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:24 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb Aug 25 07:04:24 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:24 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb" returned: 0 in 0.386s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:24 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 1G Aug 25 07:04:24 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-720ed54b-a681-4f4a-9fff-2363bc3a7cc9 req-ad502b04-053d-41a1-b927-60f7b5069767 tempest-TestShelveInstance-1700852723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:24 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 1G" returned: 0 in 0.406s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:24 devstack sudo[110289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 Aug 25 07:04:24 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:25 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:25 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 is being set with open permissions: ugo+rw Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:25 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 Aug 25 07:04:25 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:25 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" returned: 0 in 0.234s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:25 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info Aug 25 07:04:25 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:25 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:25 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info is being set with open permissions: ugo+rw Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:25 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info Aug 25 07:04:25 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:25 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.info" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-720ed54b-a681-4f4a-9fff-2363bc3a7cc9 req-ad502b04-053d-41a1-b927-60f7b5069767 tempest-TestShelveInstance-1700852723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.382s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-720ed54b-a681-4f4a-9fff-2363bc3a7cc9 req-ad502b04-053d-41a1-b927-60f7b5069767 tempest-TestShelveInstance-1700852723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b6f54f5e-829f-4945-a2b0-e86d42fd5e8c tempest-VolumesSnapshotTestJSON-553439953 None] Create snapshot completed successfully Aug 25 07:04:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-720ed54b-a681-4f4a-9fff-2363bc3a7cc9 req-ad502b04-053d-41a1-b927-60f7b5069767 tempest-TestShelveInstance-1700852723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-552f51cd-9528-4adc-8d12-5c4d4ee95329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d727e5c-940c-4409-b37e-0b08b93d3604', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:04:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-720ed54b-a681-4f4a-9fff-2363bc3a7cc9 req-ad502b04-053d-41a1-b927-60f7b5069767 tempest-TestShelveInstance-1700852723 None] attachment_update completed successfully. Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-ff854fc7-e0ef-4c3f-a2b7-aef870df95f1-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-ff854fc7-e0ef-4c3f-a2b7-aef870df95f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-199a690f-58e8-4111-9b73-b6a61e2bcdeb" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-199a690f-58e8-4111-9b73-b6a61e2bcdeb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Deleting offline snapshot ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 of volume 199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] snapshot_file for this snap is: volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcd3541-26ac-4292-8962-2115a848c779]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:26 devstack sudo[110303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 Aug 25 07:04:26 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:26 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b06927-0887-4a82-8e1d-9dca04c4bd89]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:26 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb Aug 25 07:04:26 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:27 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb" returned: 0 in 0.379s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:27 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 Aug 25 07:04:27 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:27 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" returned: 0 in 0.362s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:27 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1 Aug 25 07:04:27 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:27 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb.ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-ff854fc7-e0ef-4c3f-a2b7-aef870df95f1" released by "_delete_snapshot" :: held 1.496s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-199a690f-58e8-4111-9b73-b6a61e2bcdeb" released by "delete_snapshot" :: held 1.520s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['ddf4c3e2-c28b-4a0c-b091-9e14eb42cf5a', '9eead89d-159f-446e-ae32-206af5dba9ba', 'c8a9a48f-5b2e-4b5a-b501-444b5fc07231', '55b3f302-9f3e-420d-a776-8a735c4cf408'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Delete snapshot completed successfully. Aug 25 07:04:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a459f92a-527d-4eda-a976-0db8e93ca08c tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-ff854fc7-e0ef-4c3f-a2b7-aef870df95f1-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (bfd3f776-7439-4bb3-96f7-300b06bffe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5287c83-71a4-4d04-8baa-fa6260a36dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5287c83-71a4-4d04-8baa-fa6260a36dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-5704278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb567ca-0443-4b2b-971b-ff538136ef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:29Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ffb1ba-78a7-4515-b7fc-35dc8d88f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ffb1ba-78a7-4515-b7fc-35dc8d88f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66479611-69bb-4aad-9d56-d13b21db7d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66479611-69bb-4aad-9d56-d13b21db7d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb567ca-0443-4b2b-971b-ff538136ef59', 'volume_name': 'volume-beb567ca-0443-4b2b-971b-ff538136ef59', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c78a75-1f5f-4d44-8ae4-0b0144dcb03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c78a75-1f5f-4d44-8ae4-0b0144dcb03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8537b61-bae3-4089-a0a6-6d02422b3f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:29 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Volume beb567ca-0443-4b2b-971b-ff538136ef59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb567ca-0443-4b2b-971b-ff538136ef59', 'volume_size': 1} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-5704278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb567ca-0443-4b2b-971b-ff538136ef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:29Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Creating volume beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:29 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:29 devstack sudo[110748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 1073741824 Aug 25 07:04:29 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:29 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 1073741824" returned: 0 in 0.613s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:30 devstack sudo[110775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 Aug 25 07:04:30 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:30 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59" returned: 0 in 0.276s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8537b61-bae3-4089-a0a6-6d02422b3f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb567ca-0443-4b2b-971b-ff538136ef59', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb305e92-bde0-4ecc-a900-43fd2963cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:30 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Volume volume-beb567ca-0443-4b2b-971b-ff538136ef59 (beb567ca-0443-4b2b-971b-ff538136ef59): created successfully Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb305e92-bde0-4ecc-a900-43fd2963cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (bfd3f776-7439-4bb3-96f7-300b06bffe1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1c6566f5-3093-4294-9bee-d3b5f2489b2a tempest-VolumesSnapshotTestJSON-553439953 None] Created volume successfully. Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Creating offline snapshot 8ae72e9e-50fd-4a0d-8790-bd5a106da41d of volume beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2e54d-de27-4354-912c-1917bb6b068b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:31 devstack sudo[110795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:04:31 devstack sudo[110795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:31 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 Aug 25 07:04:31 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:32 devstack sudo[110795]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.316s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:04:32 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59" returned: 0 in 0.436s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:32 devstack sudo[110808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d 1G Aug 25 07:04:32 devstack sudo[110808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:32 devstack sudo[110808]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d 1G" returned: 0 in 0.469s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb567ca-0443-4b2b-971b-ff538136ef59 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:32 devstack sudo[110815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb567ca-0443-4b2b-971b-ff538136ef59 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d Aug 25 07:04:32 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:32 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb567ca-0443-4b2b-971b-ff538136ef59 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d" returned: 0 in 0.334s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:32 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d is being set with open permissions: ugo+rw Aug 25 07:04:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:32 devstack sudo[110821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d Aug 25 07:04:32 devstack sudo[110821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:33 devstack sudo[110821]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:33 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info Aug 25 07:04:33 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:33 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info" returned: 0 in 0.280s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:33 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info is being set with open permissions: ugo+rw Aug 25 07:04:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:33 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info Aug 25 07:04:33 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:33 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.info" returned: 0 in 0.269s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:33 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e86d6253-deb0-464b-9994-ce5df0a4d276 tempest-VolumesSnapshotTestJSON-553439953 None] Create snapshot completed successfully Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (18ae4a6e-cfc4-46ed-b742-ab8999abee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b093093-838b-4e0e-89e1-a7442818f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b093093-838b-4e0e-89e1-a7442818f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-350501063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccd5fd0-b997-4291-b73d-9d1821cafe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8ae72e9e-50fd-4a0d-8790-bd5a106da41d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:35Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa60283-5be0-4aae-90a5-1a1a6cf18b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa60283-5be0-4aae-90a5-1a1a6cf18b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf6adf3-8551-46ac-8ac1-8a60693b4c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf6adf3-8551-46ac-8ac1-8a60693b4c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ccd5fd0-b997-4291-b73d-9d1821cafe8b', 'volume_name': 'volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b', 'volume_size': 2, 'snapshot_id': '8ae72e9e-50fd-4a0d-8790-bd5a106da41d'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebeaf6d-32e9-47ab-be7f-a9caca491fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebeaf6d-32e9-47ab-be7f-a9caca491fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445faa1d-bf2a-40f2-8c16-3db6c9b82365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:35 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Volume 5ccd5fd0-b997-4291-b73d-9d1821cafe8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b', 'volume_size': 2, 'snapshot_id': '8ae72e9e-50fd-4a0d-8790-bd5a106da41d'} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-8ae72e9e-50fd-4a0d-8790-bd5a106da41d-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-8ae72e9e-50fd-4a0d-8790-bd5a106da41d-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Creating volume 5ccd5fd0-b997-4291-b73d-9d1821cafe8b from snapshot 8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] snapshot: 8ae72e9e-50fd-4a0d-8790-bd5a106da41d, volume: 5ccd5fd0-b997-4291-b73d-9d1821cafe8b, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60473bf-9919-44b6-9c8e-356c4ff113b5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:35 devstack sudo[110830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d Aug 25 07:04:35 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:35 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d" returned: 0 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb567ca-0443-4b2b-971b-ff538136ef59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26c5f20-0f1f-466d-8202-834c9ea3bde2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:35 devstack sudo[110835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 Aug 25 07:04:35 devstack sudo[110835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:36 devstack sudo[110835]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:04:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:04:36 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:04:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:36 devstack sudo[110840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b Aug 25 07:04:36 devstack sudo[110840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:41 devstack sudo[110840]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" returned: 0 in 4.894s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:04:41 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Converted 1024.00 MB image at 209.19 MB/s Aug 25 07:04:41 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b is being set with open permissions: ugo+rw Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:41 devstack sudo[110854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b Aug 25 07:04:41 devstack sudo[110854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:41 devstack sudo[110854]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" released by "_copy_volume_from_snapshot" :: held 5.904s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-8ae72e9e-50fd-4a0d-8790-bd5a106da41d-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" released by "_create_volume_from_snapshot" :: held 5.966s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.981s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445faa1d-bf2a-40f2-8c16-3db6c9b82365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b', 'volume_size': 2, 'snapshot_id': '8ae72e9e-50fd-4a0d-8790-bd5a106da41d'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8aec88a-f229-4702-941e-1177e7dc58cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Volume volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b (5ccd5fd0-b997-4291-b73d-9d1821cafe8b): created successfully Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8aec88a-f229-4702-941e-1177e7dc58cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (18ae4a6e-cfc4-46ed-b742-ab8999abee0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ed4ed043-b0ec-43a3-8f3d-7851c89a5220 tempest-VolumesSnapshotTestJSON-553439953 None] Created volume successfully. Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-5ccd5fd0-b997-4291-b73d-9d1821cafe8b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-5ccd5fd0-b997-4291-b73d-9d1821cafe8b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae3b07-33be-45d7-b05c-08544745ec9d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:42 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b Aug 25 07:04:42 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:42 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" returned: 0 in 0.386s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:42 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b Aug 25 07:04:42 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:42 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" returned: 0 in 0.256s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-5ccd5fd0-b997-4291-b73d-9d1821cafe8b" released by "delete_volume" :: held 0.688s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:42 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['204b07bf-53dc-462a-ba19-c3172ecc0b4a', '1c1dde61-b1e5-4812-b031-6a8f0503af55', 'dde7eb50-9607-48b0-a944-0ffa274a5826', '73492049-e545-43ec-8387-7f6dcc6b081a'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:43 devstack sudo[110865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:04:43 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:43 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.233s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Deleted volume successfully. Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-087db6bb-2164-45c4-b0d3-4cf8bdd6a968 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-5ccd5fd0-b997-4291-b73d-9d1821cafe8b-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-8ae72e9e-50fd-4a0d-8790-bd5a106da41d-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-8ae72e9e-50fd-4a0d-8790-bd5a106da41d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-beb567ca-0443-4b2b-971b-ff538136ef59" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-beb567ca-0443-4b2b-971b-ff538136ef59" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-8ae72e9e-50fd-4a0d-8790-bd5a106da41d" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-8ae72e9e-50fd-4a0d-8790-bd5a106da41d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Deleting offline snapshot 8ae72e9e-50fd-4a0d-8790-bd5a106da41d of volume beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] snapshot_file for this snap is: volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[78291a16-c275-4b24-8460-db26c898788c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:43 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d Aug 25 07:04:43 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:43 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb567ca-0443-4b2b-971b-ff538136ef59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e148d-ef43-4d80-9def-d03d885eebad]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:44 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 Aug 25 07:04:44 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:44 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59" returned: 0 in 0.532s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:44 devstack sudo[110878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d Aug 25 07:04:44 devstack sudo[110878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:44 devstack sudo[110878]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d" returned: 0 in 0.357s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:44 devstack sudo[110896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d Aug 25 07:04:44 devstack sudo[110896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:45 devstack sudo[110896]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59.8ae72e9e-50fd-4a0d-8790-bd5a106da41d" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-8ae72e9e-50fd-4a0d-8790-bd5a106da41d" released by "_delete_snapshot" :: held 1.656s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-beb567ca-0443-4b2b-971b-ff538136ef59" released by "delete_snapshot" :: held 1.681s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['d992aeca-a272-4c07-83d3-298364091bf5', 'a72f4388-854e-4b6d-ae9f-038926ef4c3d', 'f6657869-45f3-41cf-8726-5463df842bcb', '2b4126b9-c68d-4e76-bcc7-77f0186b45f8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:45 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Delete snapshot completed successfully. Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9a500f46-80ae-4272-9183-4862e4e47d8b tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-8ae72e9e-50fd-4a0d-8790-bd5a106da41d-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-beb567ca-0443-4b2b-971b-ff538136ef59-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-beb567ca-0443-4b2b-971b-ff538136ef59-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-beb567ca-0443-4b2b-971b-ff538136ef59" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-beb567ca-0443-4b2b-971b-ff538136ef59" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ad167-1df7-478b-802b-f2a4687b83ad]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:45 devstack sudo[110899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 Aug 25 07:04:45 devstack sudo[110899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:46 devstack sudo[110899]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:46 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59 Aug 25 07:04:46 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:46 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-beb567ca-0443-4b2b-971b-ff538136ef59" returned: 0 in 0.253s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-beb567ca-0443-4b2b-971b-ff538136ef59" released by "delete_volume" :: held 0.684s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['4c68974e-f99b-4014-9f14-e073cd4b4d1e', 'f55fc85f-74d4-4b4f-9d22-21f01184b9db', 'f00f9777-1474-4690-a74c-c871bef03583', 'd0304304-66ed-4ef1-9117-11d6d6dd110c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:46 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:04:46 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:46 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Deleted volume successfully. Aug 25 07:04:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e54b7ba5-2c3d-4248-bad9-53498f5a3dac tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-beb567ca-0443-4b2b-971b-ff538136ef59-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (4fd1125f-f7d0-4aab-ad8f-dbcd99b0dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20927978-1196-494a-9d14-c2c90532c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20927978-1196-494a-9d14-c2c90532c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-278433931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247f7414-787e-40b3-8310-45fa063ac111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:47Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88b2cb4-e9ad-4aa4-9623-ae21d2e4a302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88b2cb4-e9ad-4aa4-9623-ae21d2e4a302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471277ad-1e2b-4014-a9ee-869f26ab3c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471277ad-1e2b-4014-a9ee-869f26ab3c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247f7414-787e-40b3-8310-45fa063ac111', 'volume_name': 'volume-247f7414-787e-40b3-8310-45fa063ac111', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad9d19f-3c63-4621-8826-149bffa96295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad9d19f-3c63-4621-8826-149bffa96295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56f88c1-94c9-4ca6-bd74-9b74bc3fad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:47 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Volume 247f7414-787e-40b3-8310-45fa063ac111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247f7414-787e-40b3-8310-45fa063ac111', 'volume_size': 1} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-278433931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247f7414-787e-40b3-8310-45fa063ac111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:47Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Creating volume 247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:47 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:47 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 1073741824 Aug 25 07:04:47 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:47 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 1073741824" returned: 0 in 0.419s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:47 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 Aug 25 07:04:47 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:48 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56f88c1-94c9-4ca6-bd74-9b74bc3fad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247f7414-787e-40b3-8310-45fa063ac111', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17f3470-900e-46d9-a2c0-15657a046aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:48 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Volume volume-247f7414-787e-40b3-8310-45fa063ac111 (247f7414-787e-40b3-8310-45fa063ac111): created successfully Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17f3470-900e-46d9-a2c0-15657a046aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (4fd1125f-f7d0-4aab-ad8f-dbcd99b0dd19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fdb59dc2-fe05-40bf-93b0-bbf46b3a06e9 tempest-VolumesSnapshotTestJSON-553439953 None] Created volume successfully. Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Creating offline snapshot 2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c of volume 247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b4f15b-73b2-406d-8db1-48289b468d3e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:48 devstack sudo[110942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 Aug 25 07:04:48 devstack sudo[110942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:48 devstack sudo[110942]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111" returned: 0 in 0.387s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:48 devstack sudo[110947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c 1G Aug 25 07:04:48 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:49 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c 1G" returned: 0 in 0.400s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247f7414-787e-40b3-8310-45fa063ac111 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:49 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247f7414-787e-40b3-8310-45fa063ac111 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c Aug 25 07:04:49 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:49 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247f7414-787e-40b3-8310-45fa063ac111 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" returned: 0 in 0.301s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:49 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c is being set with open permissions: ugo+rw Aug 25 07:04:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:49 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c Aug 25 07:04:49 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:49 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:49 devstack sudo[110962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info Aug 25 07:04:49 devstack sudo[110962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:50 devstack sudo[110962]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info" returned: 0 in 0.277s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:50 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info is being set with open permissions: ugo+rw Aug 25 07:04:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:50 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info Aug 25 07:04:50 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:50 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.info" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c3fea861-81d3-4a02-864c-e743bc91e3ca tempest-VolumesSnapshotTestJSON-553439953 None] Create snapshot completed successfully Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (b6714504-ceee-4c93-9272-2b3d9b2da7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7bc1d3-749d-4926-a39e-2977e9432bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7bc1d3-749d-4926-a39e-2977e9432bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1674548165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53b42a0-3c21-48da-a79f-5c4ace8b3423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b4277362c49f487187951896c0c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:04:52Z,use_quota=True,user_id='ec1f668584d94cedb69b34bb0d936a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c688f7-5573-47d3-a201-5a2b99e1c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c688f7-5573-47d3-a201-5a2b99e1c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac7b3bf-3f1c-4ba9-bb68-426ce0180d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac7b3bf-3f1c-4ba9-bb68-426ce0180d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a53b42a0-3c21-48da-a79f-5c4ace8b3423', 'volume_name': 'volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423', 'volume_size': 1, 'snapshot_id': '2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8c0f55-6841-4fd1-ba35-a5ea3bcf6031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8c0f55-6841-4fd1-ba35-a5ea3bcf6031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de350304-3d24-49a8-86b5-ee2b86aa9b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:52 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Volume a53b42a0-3c21-48da-a79f-5c4ace8b3423: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423', 'volume_size': 1, 'snapshot_id': '2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c'} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c-a53b42a0-3c21-48da-a79f-5c4ace8b3423" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c-a53b42a0-3c21-48da-a79f-5c4ace8b3423" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Creating volume a53b42a0-3c21-48da-a79f-5c4ace8b3423 from snapshot 2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-a53b42a0-3c21-48da-a79f-5c4ace8b3423" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-a53b42a0-3c21-48da-a79f-5c4ace8b3423" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] snapshot: 2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c, volume: a53b42a0-3c21-48da-a79f-5c4ace8b3423, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae794f9-4b4b-49ce-acfb-f6dd3a0e2976]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:52 devstack sudo[110973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c Aug 25 07:04:52 devstack sudo[110973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:52 devstack sudo[110973]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" returned: 0 in 0.387s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247f7414-787e-40b3-8310-45fa063ac111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc7e694-f1a2-41f1-bb2d-aef1fe483379]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:52 devstack sudo[110978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 Aug 25 07:04:52 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:53 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111" returned: 0 in 0.464s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:04:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:04:53 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:04:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:53 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 Aug 25 07:04:53 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-bd62eb3f-efd0-414c-8d72-8193df7a521c tempest-TestShelveInstance-1700852723 None] Terminate volume connection completed successfully. Aug 25 07:04:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-bd62eb3f-efd0-414c-8d72-8193df7a521c tempest-TestShelveInstance-1700852723 None] Deleting attachment 6d727e5c-940c-4409-b37e-0b08b93d3604. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:04:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Acquiring lock "cinder-552f51cd-9528-4adc-8d12-5c4d4ee95329-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Lock "cinder-552f51cd-9528-4adc-8d12-5c4d4ee95329-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Acquiring lock "cinder-quobyte-552f51cd-9528-4adc-8d12-5c4d4ee95329" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:04:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Lock "cinder-quobyte-552f51cd-9528-4adc-8d12-5c4d4ee95329" acquired by "delete_volume" :: waited 0.049s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:04:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[794bc044-7852-46a0-83b6-0086a979ff44]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:04:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:57 devstack sudo[111029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 Aug 25 07:04:57 devstack sudo[111029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:58 devstack sudo[111029]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329" returned: 0 in 1.010s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:58 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329 Aug 25 07:04:58 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:59 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423" returned: 0 in 5.751s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:04:59 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Converted 1024.00 MB image at 178.02 MB/s Aug 25 07:04:59 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 is being set with open permissions: ugo+rw Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:59 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-552f51cd-9528-4adc-8d12-5c4d4ee95329" returned: 0 in 0.507s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Lock "cinder-quobyte-552f51cd-9528-4adc-8d12-5c4d4ee95329" released by "delete_volume" :: held 1.612s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:59 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 Aug 25 07:04:59 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.quota [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Created reservations ['c8f84e5f-cb28-4486-95c2-820bc29d96a4', '15130955-96f9-4dad-845a-f67f2424aa9e', 'a0361415-6dc4-4623-b197-63488edb599f', '7bf1ce9a-57da-4ed1-9f2a-5354b883f38d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:04:59 devstack sudo[111039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:04:59 devstack sudo[111039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:04:59 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423" returned: 0 in 0.274s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-a53b42a0-3c21-48da-a79f-5c4ace8b3423" released by "_copy_volume_from_snapshot" :: held 6.991s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c-a53b42a0-3c21-48da-a79f-5c4ace8b3423" released by "_create_volume_from_snapshot" :: held 7.077s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.096s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de350304-3d24-49a8-86b5-ee2b86aa9b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423', 'volume_size': 1, 'snapshot_id': '2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcffaa4c-fd7f-4b36-b43c-dcd298cbe6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:04:59 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Volume volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 (a53b42a0-3c21-48da-a79f-5c4ace8b3423): created successfully Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcffaa4c-fd7f-4b36-b43c-dcd298cbe6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Flow 'volume_create_manager' (b6714504-ceee-4c93-9272-2b3d9b2da7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:04:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3274ad10-0099-4b22-ba33-380c81ffd01e tempest-VolumesSnapshotTestJSON-553439953 None] Created volume successfully. Aug 25 07:04:59 devstack sudo[111039]: pam_unix(sudo:session): session closed for user root Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.302s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.manager [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:04:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Deleted volume successfully. Aug 25 07:04:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [req-7de2ac9e-91ef-474f-9099-0081fe363685 req-225598c8-20c7-471b-88d2-b10110f289f4 tempest-TestShelveInstance-1700852723 None] Lock "cinder-552f51cd-9528-4adc-8d12-5c4d4ee95329-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-a53b42a0-3c21-48da-a79f-5c4ace8b3423-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-a53b42a0-3c21-48da-a79f-5c4ace8b3423-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-a53b42a0-3c21-48da-a79f-5c4ace8b3423" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-a53b42a0-3c21-48da-a79f-5c4ace8b3423" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62350f-d59d-4d41-ac16-93d2ea420e84]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:00 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 Aug 25 07:05:00 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:00 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423" returned: 0 in 0.369s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:01 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423 Aug 25 07:05:01 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:01 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a53b42a0-3c21-48da-a79f-5c4ace8b3423" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-a53b42a0-3c21-48da-a79f-5c4ace8b3423" released by "delete_volume" :: held 0.690s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['1f3aa663-551a-4bcf-b3f4-821004caa324', '56610d21-1837-4cf8-823b-43f126daa967', 'e43ac78b-64ab-4c10-b207-bf9caf5793a3', '02caf94f-fa0f-4688-87e7-1d2277439451'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:01 devstack sudo[111053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:05:01 devstack sudo[111053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:01 devstack sudo[111053]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.264s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Deleted volume successfully. Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2305cf43-755d-481d-a212-85fe8f6f4c14 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-a53b42a0-3c21-48da-a79f-5c4ace8b3423-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-247f7414-787e-40b3-8310-45fa063ac111" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-247f7414-787e-40b3-8310-45fa063ac111" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Deleting offline snapshot 2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c of volume 247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] snapshot_file for this snap is: volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[45230b72-a7bb-45f3-a6bc-bf293ec90f13]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:01 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c Aug 25 07:05:01 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:02 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" returned: 0 in 0.377s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247f7414-787e-40b3-8310-45fa063ac111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[755707d9-0a77-4f84-b448-41ec8febf01d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:02 devstack sudo[111064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 Aug 25 07:05:02 devstack sudo[111064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:02 devstack sudo[111064]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111" returned: 0 in 0.548s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:02 devstack sudo[111069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c Aug 25 07:05:02 devstack sudo[111069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:03 devstack sudo[111069]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:03 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c Aug 25 07:05:03 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:03 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111.2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" returned: 0 in 0.288s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c" released by "_delete_snapshot" :: held 1.668s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-247f7414-787e-40b3-8310-45fa063ac111" released by "delete_snapshot" :: held 1.693s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['b596603d-cc8c-4e99-86a4-4fae05761dd6', '1db7d625-eac0-42e1-98ec-d3f51c1e2753', '5c0d8e7c-45d8-40a7-abcd-21c3f52afa10', '834de38b-e7e6-4dbf-9aa0-b32bc1af09d3'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Delete snapshot completed successfully. Aug 25 07:05:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9924b15a-fb75-42dc-9c7e-af84ec11385f tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-2ebfaf0e-8469-4a9c-933e-79d66bcf5b2c-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-247f7414-787e-40b3-8310-45fa063ac111-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-247f7414-787e-40b3-8310-45fa063ac111-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-247f7414-787e-40b3-8310-45fa063ac111" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-247f7414-787e-40b3-8310-45fa063ac111" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095b753-5d16-4a77-b40f-b2fc42a8d012]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:04 devstack sudo[111079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 Aug 25 07:05:04 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:04 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111" returned: 0 in 0.375s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:04 devstack sudo[111085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111 Aug 25 07:05:04 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:04 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-247f7414-787e-40b3-8310-45fa063ac111" returned: 0 in 0.261s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-247f7414-787e-40b3-8310-45fa063ac111" released by "delete_volume" :: held 0.718s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['ecddc29d-c01c-4e85-b72c-240517f0e37c', 'f02065e5-c011-40f6-9ffa-948bf381d08d', '28fe5468-a54b-4d4d-a2d5-0de7f4bca4d8', 'e7b4f358-bea9-4bf3-b2bb-4cc7386d3b52'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:04 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:05:04 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:05 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.262s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Deleted volume successfully. Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-77133efe-9fe5-4734-9dfc-eb2be82d2317 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-247f7414-787e-40b3-8310-45fa063ac111-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-199a690f-58e8-4111-9b73-b6a61e2bcdeb-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-199a690f-58e8-4111-9b73-b6a61e2bcdeb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "cinder-quobyte-199a690f-58e8-4111-9b73-b6a61e2bcdeb" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-199a690f-58e8-4111-9b73-b6a61e2bcdeb" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb73785-abc6-45d4-90d4-c3582b97126e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:05 devstack sudo[111091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb Aug 25 07:05:05 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:05 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb" returned: 0 in 0.379s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:05 devstack sudo[111097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb Aug 25 07:05:05 devstack sudo[111097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:05 devstack sudo[111097]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-199a690f-58e8-4111-9b73-b6a61e2bcdeb" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-quobyte-199a690f-58e8-4111-9b73-b6a61e2bcdeb" released by "delete_volume" :: held 0.670s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Created reservations ['4011a9c8-9c5f-4ce2-98c6-cd78f439da88', '5ec4ffaf-8b47-4780-b337-85b5ab80cf0a', 'fc507f87-90d8-4503-ab35-a19624e49171', 'cb9a9ae1-56bc-46d2-bbed-fff5a0294e69'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:06 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:05:06 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:06 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.237s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Deleted volume successfully. Aug 25 07:05:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-03c0393f-2bff-4c7a-98fc-85c97bfa72e7 tempest-VolumesSnapshotTestJSON-553439953 None] Lock "cinder-199a690f-58e8-4111-9b73-b6a61e2bcdeb-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Flow 'volume_create_manager' (354e085d-5d81-441f-a40e-e78572e29a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed6e31d-d3e9-49fc-b38c-fa6dd86da814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed6e31d-d3e9-49fc-b38c-fa6dd86da814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1163877446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74975087-5909-4578-baa2-874df65980df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5cee5e14a14ef194fd2152f699ccc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:05:14Z,use_quota=True,user_id='c234fcd89d84425281a505f4b3302f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c382f82-4914-4abc-85f6-c74f54cae27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c382f82-4914-4abc-85f6-c74f54cae27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e549af77-256e-4c3a-95bb-66cf11ffcb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e549af77-256e-4c3a-95bb-66cf11ffcb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74975087-5909-4578-baa2-874df65980df', 'volume_name': 'volume-74975087-5909-4578-baa2-874df65980df', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34617ab-21c3-4da9-9a23-ba5e1d14fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34617ab-21c3-4da9-9a23-ba5e1d14fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ca238a-2b19-4851-bc15-5896e75c8b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:13 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Volume 74975087-5909-4578-baa2-874df65980df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74975087-5909-4578-baa2-874df65980df', 'volume_size': 1} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1163877446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74975087-5909-4578-baa2-874df65980df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5cee5e14a14ef194fd2152f699ccc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:05:14Z,use_quota=True,user_id='c234fcd89d84425281a505f4b3302f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Creating volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:05:13 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:05:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:13 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df 1073741824 Aug 25 07:05:14 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:14 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df 1073741824" returned: 0 in 0.468s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:14 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df Aug 25 07:05:14 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:14 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ca238a-2b19-4851-bc15-5896e75c8b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74975087-5909-4578-baa2-874df65980df', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9915c6e6-cb82-4a72-8117-31a99580129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Volume volume-74975087-5909-4578-baa2-874df65980df (74975087-5909-4578-baa2-874df65980df): created successfully Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9915c6e6-cb82-4a72-8117-31a99580129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Flow 'volume_create_manager' (354e085d-5d81-441f-a40e-e78572e29a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:05:14 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e79b0e26-72c4-4dfc-834a-55f50234ed78 tempest-VolumesSnapshotListTestJSON-1441997821 None] Created volume successfully. Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Creating offline snapshot b5e900b4-222a-4303-8bbf-77f92d2c043f of volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[259591ae-a0e8-4812-8e02-712702637588]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:16 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df Aug 25 07:05:16 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:16 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df" returned: 0 in 0.381s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:16 devstack sudo[111124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f 1G Aug 25 07:05:16 devstack sudo[111124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:17 devstack sudo[111124]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f 1G" returned: 0 in 0.453s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:17 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:17 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:17 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:17 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f is being set with open permissions: ugo+rw Aug 25 07:05:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:17 devstack sudo[111135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:17 devstack sudo[111135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:17 devstack sudo[111135]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:17 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info Aug 25 07:05:17 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:18 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:18 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info is being set with open permissions: ugo+rw Aug 25 07:05:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:18 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info Aug 25 07:05:18 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:18 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.info" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2cadddca-80a6-4a10-8fe0-9f71a2a7d478 tempest-VolumesSnapshotListTestJSON-1441997821 None] Create snapshot completed successfully Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=87,cinder:UPDATE=88,cinder:DELETE=9,cinder:INSERT=22 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=95,cinder:UPDATE=95,cinder:INSERT=24,cinder:DELETE=7 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Creating offline snapshot 14664345-17c4-4252-9ce8-08a5ecd2820f of volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a4d3c-e597-4b42-83a4-68b1b6ff58fb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:19 devstack sudo[111144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:19 devstack sudo[111144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:20 devstack sudo[111144]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.422s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:20 devstack sudo[111150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f 1G Aug 25 07:05:20 devstack sudo[111150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:20 devstack sudo[111150]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f 1G" returned: 0 in 0.490s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:20 devstack sudo[111156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:20 devstack sudo[111156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:20 devstack sudo[111156]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:20 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f is being set with open permissions: ugo+rw Aug 25 07:05:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:20 devstack sudo[111162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:20 devstack sudo[111162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:21 devstack sudo[111162]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.256s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.610s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-dd23c4a7-f5e4-4833-97cc-3d3b54e738bf tempest-VolumesSnapshotListTestJSON-1441997821 None] Create snapshot completed successfully Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Creating offline snapshot 20e49070-2c7e-4327-b01d-e21ed13562e2 of volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e0c87a-4dea-43be-83a3-d47180f30309]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:22 devstack sudo[111201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:22 devstack sudo[111201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:22 devstack sudo[111201]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:22 devstack sudo[111207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 1G Aug 25 07:05:22 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:22 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 1G" returned: 0 in 0.459s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:22 devstack sudo[111214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 Aug 25 07:05:22 devstack sudo[111214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:23 devstack sudo[111214]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2" returned: 0 in 0.320s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:23 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 is being set with open permissions: ugo+rw Aug 25 07:05:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:23 devstack sudo[111219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 Aug 25 07:05:23 devstack sudo[111219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:23 devstack sudo[111219]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.543s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0efc8c42-a71d-4e8a-a426-f861513e6338 tempest-VolumesSnapshotListTestJSON-1441997821 None] Create snapshot completed successfully Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-20e49070-2c7e-4327-b01d-e21ed13562e2-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-20e49070-2c7e-4327-b01d-e21ed13562e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-20e49070-2c7e-4327-b01d-e21ed13562e2" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-20e49070-2c7e-4327-b01d-e21ed13562e2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Deleting offline snapshot 20e49070-2c7e-4327-b01d-e21ed13562e2 of volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] snapshot_file for this snap is: volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281741a-d792-4de3-a204-0cd61d06c67a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:25 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 Aug 25 07:05:25 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:25 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2" returned: 0 in 0.423s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee4108f-bd24-4ddd-ba26-8d55a5b37ba4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:25 devstack sudo[111227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:25 devstack sudo[111227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:25 devstack sudo[111227]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:25 devstack sudo[111232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 Aug 25 07:05:25 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:26 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2" returned: 0 in 0.519s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:26 devstack sudo[111237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2 Aug 25 07:05:26 devstack sudo[111237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:26 devstack sudo[111237]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.20e49070-2c7e-4327-b01d-e21ed13562e2" returned: 0 in 0.273s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-20e49070-2c7e-4327-b01d-e21ed13562e2" released by "_delete_snapshot" :: held 1.703s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" released by "delete_snapshot" :: held 1.733s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Created reservations ['01bb8a85-d700-4128-bb14-216c91399ee3', '1071e6dc-a676-48be-b29b-c0cdf0621b4c', 'c6d41722-fc78-476a-a69c-dd68a9f93f79', '84a14cd3-3445-416f-958e-9f31666d6a8f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Delete snapshot completed successfully. Aug 25 07:05:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5b42d26d-a8b6-4381-8320-7f6830f8ba99 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-20e49070-2c7e-4327-b01d-e21ed13562e2-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-14664345-17c4-4252-9ce8-08a5ecd2820f-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-14664345-17c4-4252-9ce8-08a5ecd2820f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-14664345-17c4-4252-9ce8-08a5ecd2820f" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-14664345-17c4-4252-9ce8-08a5ecd2820f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Deleting offline snapshot 14664345-17c4-4252-9ce8-08a5ecd2820f of volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] snapshot_file for this snap is: volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d4481b-1c11-479b-ad6e-6c4989549d76]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:27 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:27 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:27 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.443s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[acec6569-0169-4a00-a227-30633a7421e4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:27 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:27 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:27 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.362s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:28 devstack sudo[111250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:28 devstack sudo[111250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:28 devstack sudo[111250]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:28 devstack sudo[111255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f Aug 25 07:05:28 devstack sudo[111255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:28 devstack sudo[111255]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.14664345-17c4-4252-9ce8-08a5ecd2820f" returned: 0 in 0.279s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-14664345-17c4-4252-9ce8-08a5ecd2820f" released by "_delete_snapshot" :: held 1.588s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" released by "delete_snapshot" :: held 1.614s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Created reservations ['b2ea57e1-2974-4434-b8a7-17d77536f4d5', 'a01d6f2c-8fe9-4f02-bab7-4e0ee181fcb2', '71fed291-ec39-4426-97e9-3ef790b6c8f0', '08e4c614-9588-4def-a535-9c47723481f3'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Delete snapshot completed successfully. Aug 25 07:05:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f59a648a-ce93-49f5-8b3b-2de9000a25ad tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-14664345-17c4-4252-9ce8-08a5ecd2820f-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-b5e900b4-222a-4303-8bbf-77f92d2c043f-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-b5e900b4-222a-4303-8bbf-77f92d2c043f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-b5e900b4-222a-4303-8bbf-77f92d2c043f" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-b5e900b4-222a-4303-8bbf-77f92d2c043f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Deleting offline snapshot b5e900b4-222a-4303-8bbf-77f92d2c043f of volume 74975087-5909-4578-baa2-874df65980df {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] snapshot_file for this snap is: volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb75d9d4-9777-4ded-934d-32001cf0f5dc]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:29 devstack sudo[111258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:29 devstack sudo[111258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:29 devstack sudo[111258]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.372s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74975087-5909-4578-baa2-874df65980df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d842e-ad5a-4096-8098-20df189ce7ab]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:29 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df Aug 25 07:05:29 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:30 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df" returned: 0 in 0.398s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:30 devstack sudo[111269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:30 devstack sudo[111269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:30 devstack sudo[111269]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.382s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:30 devstack sudo[111274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f Aug 25 07:05:30 devstack sudo[111274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:30 devstack sudo[111274]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df.b5e900b4-222a-4303-8bbf-77f92d2c043f" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-b5e900b4-222a-4303-8bbf-77f92d2c043f" released by "_delete_snapshot" :: held 1.538s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" released by "delete_snapshot" :: held 1.561s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Created reservations ['83f24c85-ebbb-479d-a098-ab7fcfbea04b', '40089a33-fb70-456a-8037-b068ed51ca85', 'f34b7b94-3559-45b7-b4f4-1bef7f6e778d', '4cbf230e-140d-4207-9848-e2778a64a454'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Delete snapshot completed successfully. Aug 25 07:05:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b1e229fe-e285-4112-af0d-c4b568406ee2 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-b5e900b4-222a-4303-8bbf-77f92d2c043f-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Flow 'volume_create_manager' (23939dad-1969-4e21-9689-e0583fc4fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e29817-6f9e-4870-9fee-73f0542b1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e29817-6f9e-4870-9fee-73f0542b1d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-353169342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ff7db-4973-486d-a4cf-e70362de422b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac334dbe44b046569b05fdf5b2d3bb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:05:31Z,use_quota=True,user_id='90ab74a4e69d4191a2bbb5f83446b4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d47c21-36d4-46c0-93b2-cb41fe1367ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d47c21-36d4-46c0-93b2-cb41fe1367ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ba0dcf-fc29-4dd4-a017-5c5ada251d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ba0dcf-fc29-4dd4-a017-5c5ada251d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1ff7db-4973-486d-a4cf-e70362de422b', 'volume_name': 'volume-ae1ff7db-4973-486d-a4cf-e70362de422b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40732c51-f404-40a1-8d54-77aef3d016bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40732c51-f404-40a1-8d54-77aef3d016bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0f5052-8c66-44b9-90b6-72551c8fca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:31 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Volume ae1ff7db-4973-486d-a4cf-e70362de422b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1ff7db-4973-486d-a4cf-e70362de422b', 'volume_size': 1} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-353169342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ff7db-4973-486d-a4cf-e70362de422b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac334dbe44b046569b05fdf5b2d3bb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:05:31Z,use_quota=True,user_id='90ab74a4e69d4191a2bbb5f83446b4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Creating volume ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:05:31 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-74975087-5909-4578-baa2-874df65980df-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:31 devstack sudo[111277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b 1073741824 Aug 25 07:05:31 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-74975087-5909-4578-baa2-874df65980df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf29ad-b77c-4ebc-890b-509900568ed8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:31 devstack sudo[111279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df Aug 25 07:05:31 devstack sudo[111279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:31 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:05:31 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:31 devstack sudo[111279]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:31 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df" returned: 0 in 0.367s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b 1073741824" returned: 0 in 0.509s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:31 devstack sudo[111291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df Aug 25 07:05:31 devstack sudo[111291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:32 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b Aug 25 07:05:32 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:32 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.291s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:05:32 devstack sudo[111291]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-74975087-5909-4578-baa2-874df65980df" returned: 0 in 0.265s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-quobyte-74975087-5909-4578-baa2-874df65980df" released by "delete_volume" :: held 0.698s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Created reservations ['254cc7ac-eb8f-4778-bd7a-2a2ffcabb4d0', 'b6f9cc9b-1c27-46c8-a210-8ceef9b6e563', 'bc29c21f-77d5-45d0-a5f2-c28299c3adc3', '6ed17340-aba6-4480-998b-431522fd9571'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:05:32 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b" returned: 0 in 0.322s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0f5052-8c66-44b9-90b6-72551c8fca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1ff7db-4973-486d-a4cf-e70362de422b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6df3714-c082-469c-bc36-b74c02f07c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:05:32 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Volume volume-ae1ff7db-4973-486d-a4cf-e70362de422b (ae1ff7db-4973-486d-a4cf-e70362de422b): created successfully Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6df3714-c082-469c-bc36-b74c02f07c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Flow 'volume_create_manager' (23939dad-1969-4e21-9689-e0583fc4fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-322d232e-6b9b-4208-8e80-6ade323ff741 tempest-TestImageHashVerification-229736246 None] Created volume successfully. Aug 25 07:05:32 devstack sudo[111304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:05:32 devstack sudo[111304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:32 devstack sudo[111304]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.243s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:05:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Deleted volume successfully. Aug 25 07:05:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-dcf620e2-1faa-41e3-958e-9ef96351a8c7 tempest-VolumesSnapshotListTestJSON-1441997821 None] Lock "cinder-74975087-5909-4578-baa2-874df65980df-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:05:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:05:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:05:34 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a15254-3930-457a-a58d-26e7d498279b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:34 devstack sudo[111307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b Aug 25 07:05:34 devstack sudo[111307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:35 devstack sudo[111307]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b" returned: 0 in 0.400s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:35 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab7423e-f13b-40f7-b940-dcd65ee0608b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:35 devstack sudo[111312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b Aug 25 07:05:35 devstack sudo[111312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:35 devstack sudo[111312]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b" returned: 0 in 0.457s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b /opt/stack/data/cinder/conversion/ae1ff7db-4973-486d-a4cf-e70362de422b.temp_image.d1191e22-107e-4a81-be3a-57626ac0a2115t24dxxe.img {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:35 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b /opt/stack/data/cinder/conversion/ae1ff7db-4973-486d-a4cf-e70362de422b.temp_image.d1191e22-107e-4a81-be3a-57626ac0a2115t24dxxe.img Aug 25 07:05:35 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:40 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b /opt/stack/data/cinder/conversion/ae1ff7db-4973-486d-a4cf-e70362de422b.temp_image.d1191e22-107e-4a81-be3a-57626ac0a2115t24dxxe.img" returned: 0 in 4.858s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032da98-3caa-458a-89b5-09158487d0ac]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:05:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:05:40 devstack sudo[111331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b Aug 25 07:05:40 devstack sudo[111331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:05:41 devstack sudo[111331]: pam_unix(sudo:session): session closed for user root Aug 25 07:05:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b" returned: 0 in 0.610s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:05:41 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/conversion/ae1ff7db-4973-486d-a4cf-e70362de422b.temp_image.d1191e22-107e-4a81-be3a-57626ac0a2115t24dxxe.img {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:05:41 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Converted 1024.00 MB image at 210.73 MB/s Aug 25 07:05:41 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] d1191e22-107e-4a81-be3a-57626ac0a211 was raw, no need to convert to raw {{(pid=94460) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 25 07:05:42 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=6,cinder:UPDATE=28 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:05:51 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=11,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Flow 'volume_create_manager' (12466657-a7fc-4e15-ad5d-34d3df1d35ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0f1155-38a4-42cc-bca4-97a34869c2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0f1155-38a4-42cc-bca4-97a34869c2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-474396128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddb6f44a1924f879d5be9ef98c85df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:02Z,use_quota=True,user_id='f6677b9860794d52a75bf4a687c73344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563e412d-5985-40ef-8dd8-528beed0b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563e412d-5985-40ef-8dd8-528beed0b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f07b0f-1002-4609-bb20-3bfda87e8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f07b0f-1002-4609-bb20-3bfda87e8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52d6bd3-9ccb-45c7-90b9-ff18bf5cf401', 'volume_name': 'volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce75484-1cc5-43a2-ad32-76cd5ce89a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce75484-1cc5-43a2-ad32-76cd5ce89a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e15179d-d11b-4ed1-a23d-c09a18b87f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Volume d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401', 'volume_size': 1} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.146s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Uploaded volume to glance image-id: d1191e22-107e-4a81-be3a-57626ac0a211. {{(pid=94460) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1801}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-474396128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddb6f44a1924f879d5be9ef98c85df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:02Z,use_quota=True,user_id='f6677b9860794d52a75bf4a687c73344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Creating volume d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:02 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:02 devstack sudo[111341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 1073741824 Aug 25 07:06:02 devstack sudo[111341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-aa8a8068-dd46-4aea-9128-5856691257ca tempest-TestImageHashVerification-229736246 None] Copy volume to image completed successfully. Aug 25 07:06:03 devstack sudo[111341]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 1073741824" returned: 0 in 0.499s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:03 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 Aug 25 07:06:03 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Acquiring lock "cinder-ae1ff7db-4973-486d-a4cf-e70362de422b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Lock "cinder-ae1ff7db-4973-486d-a4cf-e70362de422b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:03 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Acquiring lock "cinder-quobyte-ae1ff7db-4973-486d-a4cf-e70362de422b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" returned: 0 in 0.311s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e15179d-d11b-4ed1-a23d-c09a18b87f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863a8715-baca-4b09-8349-b11296a6c06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Lock "cinder-quobyte-ae1ff7db-4973-486d-a4cf-e70362de422b" acquired by "delete_volume" :: waited 0.038s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0842ae88-947f-4b62-9ea0-ac587304dd33]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:03 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Volume volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 (d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401): created successfully Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863a8715-baca-4b09-8349-b11296a6c06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Flow 'volume_create_manager' (12466657-a7fc-4e15-ad5d-34d3df1d35ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9d0366de-6313-449c-9547-473700a51eac tempest-TestStampPattern-746667222 None] Created volume successfully. Aug 25 07:06:03 devstack sudo[111353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b Aug 25 07:06:03 devstack sudo[111353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:04 devstack sudo[111353]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:04 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b Aug 25 07:06:04 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:04 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ae1ff7db-4973-486d-a4cf-e70362de422b" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Lock "cinder-quobyte-ae1ff7db-4973-486d-a4cf-e70362de422b" released by "delete_volume" :: held 0.742s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Created reservations ['e972bd4f-e579-43ca-a1dc-b7452c2c4483', '05cbae4b-f7e4-4625-8afc-c9f034380415', '5f82422b-04aa-48a1-8abf-c18d3ca41d04', 'c067cc90-bcc5-4c1c-9186-80226798ee19'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:04 devstack sudo[111361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:04 devstack sudo[111361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:04 devstack sudo[111361]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.299s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Deleted volume successfully. Aug 25 07:06:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4471bd89-9e8b-4346-95cc-a10c98869682 tempest-TestImageHashVerification-229736246 None] Lock "cinder-ae1ff7db-4973-486d-a4cf-e70362de422b-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:14 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:06:14 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=12,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Flow 'volume_create_manager' (821dbab0-f1ef-4493-a32c-2cae2d3d9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03c315c-29b8-4ced-a8db-06df525de431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03c315c-29b8-4ced-a8db-06df525de431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491b8b3c-046d-424a-9d05-b8868167fd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3add386206374e798d58c12f35589820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:21Z,use_quota=True,user_id='cd9948654d9a4657af0c09d5b08a9837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c33235e2-d1d6-4896-836b-fc8056690521),volume_type_id=c33235e2-d1d6-4896-836b-fc8056690521)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f593b4-f32b-4a84-b3f5-bbe9db426efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f593b4-f32b-4a84-b3f5-bbe9db426efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc0c4f5-cf3f-4203-b370-ea3b45a7b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc0c4f5-cf3f-4203-b370-ea3b45a7b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '491b8b3c-046d-424a-9d05-b8868167fd7e', 'volume_name': 'volume-491b8b3c-046d-424a-9d05-b8868167fd7e', 'volume_size': 1, 'image_id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/050c360c-9187-4af0-987a-507de6ba8f9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afd90b780a5f063f870945ea1a37b513', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3add386206374e798d58c12f35589820', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa7eb6ea019230d5ca679ce4aa2b5b73dfe053a5f72e5230f82a74e804e2f80b4b17b23a9b70a28e76b28bb6a8d2fcca65ae824f892457af8ebc73b2b8a85f98', 'id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'created_at': datetime.datetime(2026, 8, 25, 5, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/050c360c-9187-4af0-987a-507de6ba8f9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3dfc99-5931-4446-ae5e-26e60d972a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3dfc99-5931-4446-ae5e-26e60d972a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286d9d02-2ba8-4dcf-909f-615050004e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Volume 491b8b3c-046d-424a-9d05-b8868167fd7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-491b8b3c-046d-424a-9d05-b8868167fd7e', 'volume_size': 1, 'image_id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/050c360c-9187-4af0-987a-507de6ba8f9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afd90b780a5f063f870945ea1a37b513', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3add386206374e798d58c12f35589820', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa7eb6ea019230d5ca679ce4aa2b5b73dfe053a5f72e5230f82a74e804e2f80b4b17b23a9b70a28e76b28bb6a8d2fcca65ae824f892457af8ebc73b2b8a85f98', 'id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'created_at': datetime.datetime(2026, 8, 25, 5, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/050c360c-9187-4af0-987a-507de6ba8f9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Trying to clone 491b8b3c-046d-424a-9d05-b8868167fd7e from image 050c360c-9187-4af0-987a-507de6ba8f9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/050c360c-9187-4af0-987a-507de6ba8f9a', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:06:21 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2860c-471a-4231-9f7f-97d418dc39e8]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:22 devstack sudo[111531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD Aug 25 07:06:22 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:22 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:22 devstack sudo[111535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD Aug 25 07:06:22 devstack sudo[111535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:22 devstack sudo[111535]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Temporary image 050c360c-9187-4af0-987a-507de6ba8f9a is fetched for user cd9948654d9a4657af0c09d5b08a9837. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a32ae0-2f93-49e3-9047-32c9f70eb9c0]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:22 devstack sudo[111540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD Aug 25 07:06:22 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:23 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:23 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD Aug 25 07:06:23 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:23 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491b8b3c-046d-424a-9d05-b8868167fd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3add386206374e798d58c12f35589820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:21Z,use_quota=True,user_id='cd9948654d9a4657af0c09d5b08a9837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c33235e2-d1d6-4896-836b-fc8056690521),volume_type_id=c33235e2-d1d6-4896-836b-fc8056690521)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Creating volume 491b8b3c-046d-424a-9d05-b8868167fd7e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:23 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:23 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e 1073741824 Aug 25 07:06:23 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:23 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e 1073741824" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:23 devstack sudo[111555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e Aug 25 07:06:23 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:24 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Attempting download of 050c360c-9187-4af0-987a-507de6ba8f9a ((None, [{'url': 'file:///opt/stack/data/glance/images/050c360c-9187-4af0-987a-507de6ba8f9a', 'metadata': {}}])) to volume 491b8b3c-046d-424a-9d05-b8868167fd7e. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[537f7b6e-7adb-4fb2-a13d-d20c1d7dec72]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:24 devstack sudo[111558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl Aug 25 07:06:24 devstack sudo[111558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:24 devstack sudo[111558]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:24 devstack sudo[111562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl Aug 25 07:06:24 devstack sudo[111562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:24 devstack sudo[111562]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl" returned: 1 in 0.324s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_050c360c-9187-4af0-987a-507de6ba8f9a_utsq4dyl' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ac556f-7c21-4ef3-bcaf-137cb2870176]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:24 devstack sudo[111566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD Aug 25 07:06:24 devstack sudo[111566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:25 devstack sudo[111566]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD" returned: 0 in 0.307s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:25 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD Aug 25 07:06:25 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:25 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD" returned: 1 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] 050c360c-9187-4af0-987a-507de6ba8f9a was raw, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:25 devstack sudo[111575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e Aug 25 07:06:25 devstack sudo[111575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:25 devstack sudo[111575]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_050c360c-9187-4af0-987a-507de6ba8f9a_vpsi35b_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:06:25 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:06:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:25 devstack sudo[111580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e 1G Aug 25 07:06:25 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:26 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e 1G" returned: 0 in 0.292s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Downloaded image 050c360c-9187-4af0-987a-507de6ba8f9a ((None, [{'url': 'file:///opt/stack/data/glance/images/050c360c-9187-4af0-987a-507de6ba8f9a', 'metadata': {}}])) to volume 491b8b3c-046d-424a-9d05-b8868167fd7e successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Temporary image 050c360c-9187-4af0-987a-507de6ba8f9a for user cd9948654d9a4657af0c09d5b08a9837 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Marking volume 491b8b3c-046d-424a-9d05-b8868167fd7e as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Copying metadata from image 050c360c-9187-4af0-987a-507de6ba8f9a to 491b8b3c-046d-424a-9d05-b8868167fd7e. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Creating volume glance metadata for volume 491b8b3c-046d-424a-9d05-b8868167fd7e backed by image 050c360c-9187-4af0-987a-507de6ba8f9a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'afd90b780a5f063f870945ea1a37b513', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286d9d02-2ba8-4dcf-909f-615050004e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491b8b3c-046d-424a-9d05-b8868167fd7e', 'volume_size': 1, 'image_id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/050c360c-9187-4af0-987a-507de6ba8f9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afd90b780a5f063f870945ea1a37b513', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3add386206374e798d58c12f35589820', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa7eb6ea019230d5ca679ce4aa2b5b73dfe053a5f72e5230f82a74e804e2f80b4b17b23a9b70a28e76b28bb6a8d2fcca65ae824f892457af8ebc73b2b8a85f98', 'id': '050c360c-9187-4af0-987a-507de6ba8f9a', 'created_at': datetime.datetime(2026, 8, 25, 5, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/050c360c-9187-4af0-987a-507de6ba8f9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891a7987-0c78-4486-8f3a-6868ab918694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:26 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Volume volume-491b8b3c-046d-424a-9d05-b8868167fd7e (491b8b3c-046d-424a-9d05-b8868167fd7e): created successfully Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891a7987-0c78-4486-8f3a-6868ab918694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Flow 'volume_create_manager' (821dbab0-f1ef-4493-a32c-2cae2d3d9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-63d74ca8-ace1-4b6d-aa48-d832ad82036f tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Created volume successfully. Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Acquiring lock "cinder-491b8b3c-046d-424a-9d05-b8868167fd7e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "cinder-491b8b3c-046d-424a-9d05-b8868167fd7e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Acquiring lock "cinder-quobyte-491b8b3c-046d-424a-9d05-b8868167fd7e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "cinder-quobyte-491b8b3c-046d-424a-9d05-b8868167fd7e" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[61131854-802a-4594-ba36-e917d7087219]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:26 devstack sudo[111585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e Aug 25 07:06:26 devstack sudo[111585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:27 devstack sudo[111585]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e" returned: 0 in 0.340s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:27 devstack sudo[111590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e Aug 25 07:06:27 devstack sudo[111590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:27 devstack sudo[111590]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-491b8b3c-046d-424a-9d05-b8868167fd7e" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "cinder-quobyte-491b8b3c-046d-424a-9d05-b8868167fd7e" released by "delete_volume" :: held 0.620s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:27 devstack cinder-volume[94460]: WARNING cinder.quota [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:06:27 devstack cinder-volume[94460]: WARNING cinder.quota [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Created reservations ['75670513-10dc-4f55-9e3e-37c79a7ec069', '6cf36852-9ca9-4e5e-a8f5-ee17dd1c600a', 'bd9fd1ab-e7d4-4cdd-a676-64cd93143bb7', 'e25a601c-1ceb-40e5-9a2d-ccd71f826ef8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:27 devstack sudo[111593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:27 devstack sudo[111593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:27 devstack sudo[111593]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.242s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:27 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Deleted volume successfully. Aug 25 07:06:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e37c6270-5341-41f9-8dd4-2448ae458f59 tempest-VolumeAndVolumeTypeFromImageTest-812978109 None] Lock "cinder-491b8b3c-046d-424a-9d05-b8868167fd7e-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:31 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:31 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.279s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (2aa05840-bb39-4fa0-9986-c871b7d3e1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8887878c-65ce-4079-8e55-024684ddd187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8887878c-65ce-4079-8e55-024684ddd187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121745258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a02785-510d-4417-9541-2a49a56778b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:32Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c994dfc8-f64e-4bbd-b9ff-36cbd624b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c994dfc8-f64e-4bbd-b9ff-36cbd624b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ec4f4c-7e34-4419-b513-ae42601fd6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ec4f4c-7e34-4419-b513-ae42601fd6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a02785-510d-4417-9541-2a49a56778b5', 'volume_name': 'volume-09a02785-510d-4417-9541-2a49a56778b5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cec29db-c70b-4543-9b1d-1f4a912fcc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cec29db-c70b-4543-9b1d-1f4a912fcc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408366b1-8d77-4679-b60d-b9273f47dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:32 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume 09a02785-510d-4417-9541-2a49a56778b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a02785-510d-4417-9541-2a49a56778b5', 'volume_size': 1} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121745258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a02785-510d-4417-9541-2a49a56778b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:32Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Creating volume 09a02785-510d-4417-9541-2a49a56778b5 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:32 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:32 devstack sudo[111603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 1073741824 Aug 25 07:06:32 devstack sudo[111603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack sudo[111603]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 1073741824" returned: 0 in 0.403s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:32 devstack sudo[111612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 Aug 25 07:06:32 devstack sudo[111612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:32 devstack sudo[111612]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5" returned: 0 in 0.234s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408366b1-8d77-4679-b60d-b9273f47dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a02785-510d-4417-9541-2a49a56778b5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c6d8a6-cab9-4661-9962-8a8c9ac5cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:32 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume volume-09a02785-510d-4417-9541-2a49a56778b5 (09a02785-510d-4417-9541-2a49a56778b5): created successfully Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c6d8a6-cab9-4661-9962-8a8c9ac5cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (2aa05840-bb39-4fa0-9986-c871b7d3e1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2c893344-7afc-4ed2-85aa-e345ddf46f07 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created volume successfully. Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (42e45228-a04d-4b50-9cdd-e7cd247490e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb18a96-0a47-40f2-a654-190b2cbd10c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb18a96-0a47-40f2-a654-190b2cbd10c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834158418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d010b68-1864-4a9c-b9c9-4e33b1b718a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:33Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1b2654-3739-4fc9-a4e7-1aa0b52134ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1b2654-3739-4fc9-a4e7-1aa0b52134ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae74d0e-2bd8-47ad-972b-4b0f158a1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae74d0e-2bd8-47ad-972b-4b0f158a1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d010b68-1864-4a9c-b9c9-4e33b1b718a6', 'volume_name': 'volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483dcf42-dd30-4af8-871c-dc45e4145fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483dcf42-dd30-4af8-871c-dc45e4145fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f61a1f-c034-41ef-a72d-c5a9d4800ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:33 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume 9d010b68-1864-4a9c-b9c9-4e33b1b718a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6', 'volume_size': 1} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834158418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d010b68-1864-4a9c-b9c9-4e33b1b718a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:33Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Creating volume 9d010b68-1864-4a9c-b9c9-4e33b1b718a6 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:33 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:33 devstack sudo[111622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 1073741824 Aug 25 07:06:33 devstack sudo[111622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:33 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (187e647a-9bcb-4c63-969c-78738b8c89f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d68a5b-dda1-4280-be4e-c8bd3afa693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d68a5b-dda1-4280-be4e-c8bd3afa693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-168164037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c23f301-a65a-4c8b-98c5-41b9f4d7ee65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:34Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80669877-e07b-424f-ab58-f6e6466d4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80669877-e07b-424f-ab58-f6e6466d4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3d11ec-08b6-453a-bfbb-b3b3bc7358dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3d11ec-08b6-453a-bfbb-b3b3bc7358dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c23f301-a65a-4c8b-98c5-41b9f4d7ee65', 'volume_name': 'volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287c2281-b685-4a79-beb0-2f72b6b4eff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287c2281-b685-4a79-beb0-2f72b6b4eff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1b6bf0-2e2c-4024-8c48-c11aee3e730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume 7c23f301-a65a-4c8b-98c5-41b9f4d7ee65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65', 'volume_size': 1} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-b14ef6c1-d21d-4d60-a4dd-a54a7b9114db req-6423453f-7ee0-491d-a257-1c92d10810f4 tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:34 devstack sudo[111622]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 1073741824" returned: 0 in 0.610s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:34 devstack sudo[111637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 Aug 25 07:06:34 devstack sudo[111637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (f63de496-0b84-4316-bb4a-bf04e7ef0902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b4a95-4fd9-46f6-827e-c273afd77980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131b4a95-4fd9-46f6-827e-c273afd77980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-379587917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0267c78a-4622-4628-a1a2-f9d7ffe8c611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:34Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29008bc8-d345-4d74-a6c3-2f1096315fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29008bc8-d345-4d74-a6c3-2f1096315fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb58ea4-144f-4757-b678-0fd8c86fb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb58ea4-144f-4757-b678-0fd8c86fb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0267c78a-4622-4628-a1a2-f9d7ffe8c611', 'volume_name': 'volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6b39e4-bd18-4406-8068-97209f000627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6b39e4-bd18-4406-8068-97209f000627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1822b6b2-0441-4292-beca-74c7196714fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume 0267c78a-4622-4628-a1a2-f9d7ffe8c611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611', 'volume_size': 1} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:34 devstack sudo[111637]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-168164037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c23f301-a65a-4c8b-98c5-41b9f4d7ee65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:34Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Creating volume 7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:34 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f61a1f-c034-41ef-a72d-c5a9d4800ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack sudo[111640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 1073741824 Aug 25 07:06:34 devstack sudo[111640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8827d51b-5bba-4479-912a-164426bdd8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 (9d010b68-1864-4a9c-b9c9-4e33b1b718a6): created successfully Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8827d51b-5bba-4479-912a-164426bdd8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (42e45228-a04d-4b50-9cdd-e7cd247490e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fcf371da-981c-40c6-991e-bbdb2bc23314 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created volume successfully. Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (8ff7e6b6-ce79-494c-b5d3-30cfab45ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abebe8e-41d0-486c-9ea0-be4c0b5bbbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abebe8e-41d0-486c-9ea0-be4c0b5bbbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656517246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d84084b-3ce9-4aad-95ff-714f4468bc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:35Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81a6893-9c4b-4b9b-9833-7273c258d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81a6893-9c4b-4b9b-9833-7273c258d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac61fbc-9cd8-4136-8c0d-d2ee4060a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac61fbc-9cd8-4136-8c0d-d2ee4060a005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d84084b-3ce9-4aad-95ff-714f4468bc93', 'volume_name': 'volume-2d84084b-3ce9-4aad-95ff-714f4468bc93', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7797d2a2-ec5e-4ddd-9f11-1ff923de2b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7797d2a2-ec5e-4ddd-9f11-1ff923de2b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffe6da4-3f76-4d40-908e-5a7c39834007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume 2d84084b-3ce9-4aad-95ff-714f4468bc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d84084b-3ce9-4aad-95ff-714f4468bc93', 'volume_size': 1} Aug 25 07:06:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:35 devstack sudo[111640]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 1073741824" returned: 0 in 0.501s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (862f2148-bb75-41bd-9264-031429035d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20d8be2-3745-407d-84fc-a72dcf4af92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20d8be2-3745-407d-84fc-a72dcf4af92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206038105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac6c473-2e80-4909-911d-5e8b16adca14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:35Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c63719a-b6a3-44b5-af47-ffc688a9a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c63719a-b6a3-44b5-af47-ffc688a9a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fdafa6-6b4a-4e06-98fe-057dfd1475fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fdafa6-6b4a-4e06-98fe-057dfd1475fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bac6c473-2e80-4909-911d-5e8b16adca14', 'volume_name': 'volume-bac6c473-2e80-4909-911d-5e8b16adca14', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39ab1b6-4dc9-4390-9b2d-c62544048abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39ab1b6-4dc9-4390-9b2d-c62544048abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7aea14-c0ba-42f2-beb0-4d385f55702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume bac6c473-2e80-4909-911d-5e8b16adca14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bac6c473-2e80-4909-911d-5e8b16adca14', 'volume_size': 1} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:35 devstack sudo[111646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 Aug 25 07:06:35 devstack sudo[111646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:35 devstack sudo[111646]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-b14ef6c1-d21d-4d60-a4dd-a54a7b9114db req-6423453f-7ee0-491d-a257-1c92d10810f4 tempest-TestStampPattern-746667222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.315s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1b6bf0-2e2c-4024-8c48-c11aee3e730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969eb8cb-4aee-4483-904e-57c926346c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-b14ef6c1-d21d-4d60-a4dd-a54a7b9114db req-6423453f-7ee0-491d-a257-1c92d10810f4 tempest-TestStampPattern-746667222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-379587917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0267c78a-4622-4628-a1a2-f9d7ffe8c611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:34Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Creating volume 0267c78a-4622-4628-a1a2-f9d7ffe8c611 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:35 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:35 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 (7c23f301-a65a-4c8b-98c5-41b9f4d7ee65): created successfully Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969eb8cb-4aee-4483-904e-57c926346c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:35 devstack sudo[111649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 1073741824 Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (187e647a-9bcb-4c63-969c-78738b8c89f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:35 devstack sudo[111649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1bba77a8-e9a6-4df3-9a03-011014b7003f tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created volume successfully. Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-b14ef6c1-d21d-4d60-a4dd-a54a7b9114db req-6423453f-7ee0-491d-a257-1c92d10810f4 tempest-TestStampPattern-746667222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6d24688-093c-426f-a78b-683b2f8ef8ee', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:06:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-b14ef6c1-d21d-4d60-a4dd-a54a7b9114db req-6423453f-7ee0-491d-a257-1c92d10810f4 tempest-TestStampPattern-746667222 None] attachment_update completed successfully. Aug 25 07:06:35 devstack sudo[111649]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 1073741824" returned: 0 in 0.427s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:35 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 Aug 25 07:06:35 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656517246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d84084b-3ce9-4aad-95ff-714f4468bc93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:35Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Creating volume 2d84084b-3ce9-4aad-95ff-714f4468bc93 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:36 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1822b6b2-0441-4292-beca-74c7196714fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfcaafe-707d-4bf5-9476-edc41163d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:36 devstack sudo[112042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 1073741824 Aug 25 07:06:36 devstack sudo[112042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 (0267c78a-4622-4628-a1a2-f9d7ffe8c611): created successfully Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfcaafe-707d-4bf5-9476-edc41163d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (f63de496-0b84-4316-bb4a-bf04e7ef0902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8333030a-3e58-4cb9-ac3a-ae602809e181 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created volume successfully. Aug 25 07:06:36 devstack sudo[112042]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 1073741824" returned: 0 in 0.477s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:36 devstack sudo[112047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 Aug 25 07:06:36 devstack sudo[112047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack sudo[112047]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93" returned: 0 in 0.265s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.792s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206038105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac6c473-2e80-4909-911d-5e8b16adca14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfbadccfa2864924b4dcb677bbbc462b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:35Z,use_quota=True,user_id='41cb171942424fd3964fcbabd313c612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Creating volume bac6c473-2e80-4909-911d-5e8b16adca14 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:36 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffe6da4-3f76-4d40-908e-5a7c39834007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d84084b-3ce9-4aad-95ff-714f4468bc93', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:36 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 1073741824 Aug 25 07:06:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9068c10e-1ab5-43b0-ae64-e980bdc46ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:36 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 (2d84084b-3ce9-4aad-95ff-714f4468bc93): created successfully Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9068c10e-1ab5-43b0-ae64-e980bdc46ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (8ff7e6b6-ce79-494c-b5d3-30cfab45ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d1e34ed4-d316-42a7-9524-07c6010c4b74 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created volume successfully. Aug 25 07:06:37 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 1073741824" returned: 0 in 0.449s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:37 devstack sudo[112064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 Aug 25 07:06:37 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:37 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14" returned: 0 in 0.239s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7aea14-c0ba-42f2-beb0-4d385f55702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac6c473-2e80-4909-911d-5e8b16adca14', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6dd42-a2f2-4175-bb2b-8a7b6bd22643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Volume volume-bac6c473-2e80-4909-911d-5e8b16adca14 (bac6c473-2e80-4909-911d-5e8b16adca14): created successfully Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6dd42-a2f2-4175-bb2b-8a7b6bd22643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Flow 'volume_create_manager' (862f2148-bb75-41bd-9264-031429035d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7ed425f4-740a-4074-8e9d-fa851b598de8 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created volume successfully. Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-bac6c473-2e80-4909-911d-5e8b16adca14-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-bac6c473-2e80-4909-911d-5e8b16adca14-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-quobyte-bac6c473-2e80-4909-911d-5e8b16adca14" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-bac6c473-2e80-4909-911d-5e8b16adca14" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2fbd12-fdac-4223-9be1-f4f944ea0fab]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:38 devstack sudo[112069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 Aug 25 07:06:38 devstack sudo[112069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:38 devstack sudo[112069]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14" returned: 0 in 0.365s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:38 devstack sudo[112075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14 Aug 25 07:06:38 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:39 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-bac6c473-2e80-4909-911d-5e8b16adca14" returned: 0 in 0.237s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-bac6c473-2e80-4909-911d-5e8b16adca14" released by "delete_volume" :: held 0.641s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created reservations ['99c215fb-795b-409b-bb02-0255d68cc145', 'e140d462-201f-4917-aa84-ba88bf31b59e', 'ccc3d1ec-7f69-47c2-bed7-f89647671d5c', '5d2c4cfd-2c4a-4beb-a183-986f81b614ba'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:39 devstack sudo[112084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:39 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:39 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Deleted volume successfully. Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d1b47bd-5f4a-4d88-9e18-5bb3ebeaf4ee tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-bac6c473-2e80-4909-911d-5e8b16adca14-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-2d84084b-3ce9-4aad-95ff-714f4468bc93-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-2d84084b-3ce9-4aad-95ff-714f4468bc93-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-quobyte-2d84084b-3ce9-4aad-95ff-714f4468bc93" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-2d84084b-3ce9-4aad-95ff-714f4468bc93" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1386b-1117-4055-af93-4572221eb340]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:39 devstack sudo[112092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 Aug 25 07:06:39 devstack sudo[112092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:40 devstack sudo[112092]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:40 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93 Aug 25 07:06:40 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:40 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2d84084b-3ce9-4aad-95ff-714f4468bc93" returned: 0 in 0.253s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-c399c46e-90c4-4e09-b2fd-2625f9824b63 req-feb9f799-d01f-4814-989e-840fea648f06 tempest-TestStampPattern-746667222 None] Terminate volume connection completed successfully. Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-c399c46e-90c4-4e09-b2fd-2625f9824b63 req-feb9f799-d01f-4814-989e-840fea648f06 tempest-TestStampPattern-746667222 None] Deleting attachment d6d24688-093c-426f-a78b-683b2f8ef8ee. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-2d84084b-3ce9-4aad-95ff-714f4468bc93" released by "delete_volume" :: held 0.670s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created reservations ['55dd8d4c-efc9-4c7f-b2f9-a466f50a312b', 'faaf1c92-6ff4-438d-a318-b2fb796667ad', 'bbd94c95-0c86-442a-af59-9cac1c7b786e', '88d09891-a0c7-41c7-b5f0-5fc8536a706f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:40 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:40 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:40 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Deleted volume successfully. Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1fdc94fa-e420-4336-a80b-907f6f6fc72c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-2d84084b-3ce9-4aad-95ff-714f4468bc93-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-0267c78a-4622-4628-a1a2-f9d7ffe8c611-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-0267c78a-4622-4628-a1a2-f9d7ffe8c611-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-quobyte-0267c78a-4622-4628-a1a2-f9d7ffe8c611" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-0267c78a-4622-4628-a1a2-f9d7ffe8c611" acquired by "delete_volume" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e98c30-f0f6-4079-b781-5ac95b4da57b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 Aug 25 07:06:41 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Creating offline snapshot 935782b4-4c80-40d4-9e9a-50590d5d3173 of volume d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e3cea3-f949-4435-a8aa-a8d9c2ac3fba]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611" returned: 0 in 0.381s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611 Aug 25 07:06:41 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack sudo[112139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 Aug 25 07:06:41 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0267c78a-4622-4628-a1a2-f9d7ffe8c611" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-0267c78a-4622-4628-a1a2-f9d7ffe8c611" released by "delete_volume" :: held 0.669s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created reservations ['da7bcd78-5843-44a0-b135-ad2a11f26304', '271b6d11-01ee-4865-a1a4-15b2f7cd987c', 'c196dd49-585d-44ab-ae89-ce220a50ca7d', '817d4904-412c-4a92-89ea-d86e8e4e4df2'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:41 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[112147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 1G Aug 25 07:06:41 devstack sudo[112147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:41 devstack sudo[112149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:41 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:41 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.239s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:41 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Deleted volume successfully. Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c2abafdd-84d3-4b3d-97fb-7d38ef5ae76c tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-0267c78a-4622-4628-a1a2-f9d7ffe8c611-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-quobyte-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:42 devstack sudo[112147]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 1G" returned: 0 in 0.461s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2d8b55-7320-41f1-918f-1b925d91dc82]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[112156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 Aug 25 07:06:42 devstack sudo[112156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack sudo[112157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 Aug 25 07:06:42 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack sudo[112156]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173" returned: 0 in 0.279s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 is being set with open permissions: ugo+rw Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[112163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 Aug 25 07:06:42 devstack sudo[112163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65" returned: 0 in 0.370s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[112168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65 Aug 25 07:06:42 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack sudo[112163]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173" returned: 0 in 0.242s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[112171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info Aug 25 07:06:42 devstack sudo[112171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65" returned: 0 in 0.253s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65" released by "delete_volume" :: held 0.667s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created reservations ['694f643c-accd-48a1-b452-394935d43a20', '7aaca519-844a-4803-bf60-3f8b4aebe183', 'a42a9bfd-472d-4276-acda-7632bbc442c7', 'ff4d4983-7feb-4cf2-b5e9-229282591bbc'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:42 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:42 devstack sudo[112171]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:42 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info is being set with open permissions: ugo+rw Aug 25 07:06:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:42 devstack sudo[112177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info Aug 25 07:06:42 devstack sudo[112177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.239s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Deleted volume successfully. Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d7392ec9-94f9-4031-898e-d058ac5c7346 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-7c23f301-a65a-4c8b-98c5-41b9f4d7ee65-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:43 devstack sudo[112177]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.info" returned: 0 in 0.244s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-9d010b68-1864-4a9c-b9c9-4e33b1b718a6-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-9d010b68-1864-4a9c-b9c9-4e33b1b718a6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-70d86b37-f22d-4f2d-bee5-d551e642d651 tempest-TestStampPattern-746667222 None] Create snapshot completed successfully Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-quobyte-9d010b68-1864-4a9c-b9c9-4e33b1b718a6" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-9d010b68-1864-4a9c-b9c9-4e33b1b718a6" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c6995-697d-451b-8e0f-2a50ee6130f0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:43 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 Aug 25 07:06:43 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:43 devstack sudo[112187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6 Aug 25 07:06:43 devstack sudo[112187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:43 devstack sudo[112187]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9d010b68-1864-4a9c-b9c9-4e33b1b718a6" returned: 0 in 0.264s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-9d010b68-1864-4a9c-b9c9-4e33b1b718a6" released by "delete_volume" :: held 0.658s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created reservations ['06a90143-6c41-4adc-9a0e-e35361742cfa', '2224b4a0-226f-4478-8124-6f825fc70770', '9058e707-48a4-4aaa-9679-2d257cebde6f', '86dcd68c-6e6b-4b6c-8f4e-18499237fe3b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:44 devstack sudo[112190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:44 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:44 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.260s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Deleted volume successfully. Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a1583d9f-f9c5-4ba6-9c0f-410ce5ccb350 tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-9d010b68-1864-4a9c-b9c9-4e33b1b718a6-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-09a02785-510d-4417-9541-2a49a56778b5-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-09a02785-510d-4417-9541-2a49a56778b5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "cinder-quobyte-09a02785-510d-4417-9541-2a49a56778b5" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-09a02785-510d-4417-9541-2a49a56778b5" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d87ac48-4dd4-4007-a8ce-2d9cba2ff00d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:44 devstack sudo[112193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 Aug 25 07:06:44 devstack sudo[112193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:44 devstack sudo[112193]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:44 devstack sudo[112199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5 Aug 25 07:06:44 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:45 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-09a02785-510d-4417-9541-2a49a56778b5" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-quobyte-09a02785-510d-4417-9541-2a49a56778b5" released by "delete_volume" :: held 0.726s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Created reservations ['b36ccc70-09c4-4b22-91c4-b3a57e72e689', '6cf9e0f8-3dda-41a6-a22e-cb6a776ea7c9', '537d6b19-daca-4212-9441-3f899ead3477', 'c5bbfaa6-4d98-4105-931c-d1f65df4a869'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:45 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:45 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:45 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.269s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:45 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Deleted volume successfully. Aug 25 07:06:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-836647ad-dbab-487e-b389-a1546139fb5d tempest-CreateVolumesFromSourceVolumeTest-1900301369 None] Lock "cinder-09a02785-510d-4417-9541-2a49a56778b5-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (74a6baad-c61e-4368-9e16-8d9a20531433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f99fa9-c934-4afb-a175-cb7048654cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f99fa9-c934-4afb-a175-cb7048654cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825985386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edfa7f1-b398-4818-befd-448ba18d099b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:49Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c0de42-91e1-41fc-a591-f7145213bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c0de42-91e1-41fc-a591-f7145213bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cce4c9-d432-4b67-a052-8ee77f1acffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cce4c9-d432-4b67-a052-8ee77f1acffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edfa7f1-b398-4818-befd-448ba18d099b', 'volume_name': 'volume-9edfa7f1-b398-4818-befd-448ba18d099b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b4f794-a7e8-48e6-9f76-2bc7d55e99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b4f794-a7e8-48e6-9f76-2bc7d55e99aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e5a3c5-4d6a-481f-af83-1b56c3f68d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Volume 9edfa7f1-b398-4818-befd-448ba18d099b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edfa7f1-b398-4818-befd-448ba18d099b', 'volume_size': 1} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825985386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edfa7f1-b398-4818-befd-448ba18d099b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:49Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Creating volume 9edfa7f1-b398-4818-befd-448ba18d099b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:49 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:49 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b 1073741824 Aug 25 07:06:49 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:49 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b 1073741824" returned: 0 in 0.418s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:49 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b Aug 25 07:06:49 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e5a3c5-4d6a-481f-af83-1b56c3f68d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edfa7f1-b398-4818-befd-448ba18d099b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a41aad9-f301-4351-a1c2-b7bd9ea3bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Volume volume-9edfa7f1-b398-4818-befd-448ba18d099b (9edfa7f1-b398-4818-befd-448ba18d099b): created successfully Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a41aad9-f301-4351-a1c2-b7bd9ea3bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (74a6baad-c61e-4368-9e16-8d9a20531433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fafc55db-1aa1-4827-a812-4f5bd1bf40e3 tempest-ProjectReaderTests-188255501 None] Created volume successfully. Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Flow 'volume_create_manager' (7fa56354-186c-4b16-963c-b7c7797ba95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ef524c-a1f2-4d9b-bf17-9ed18a7f29be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ef524c-a1f2-4d9b-bf17-9ed18a7f29be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-499986392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7512488-a462-4dd4-9065-242f9c6de699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddb6f44a1924f879d5be9ef98c85df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=935782b4-4c80-40d4-9e9a-50590d5d3173,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:50Z,use_quota=True,user_id='f6677b9860794d52a75bf4a687c73344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5ef33d-9cef-4b9c-a325-09acbcbed71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5ef33d-9cef-4b9c-a325-09acbcbed71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91777d13-03f8-4d6f-b7c3-fed547d148d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91777d13-03f8-4d6f-b7c3-fed547d148d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7512488-a462-4dd4-9065-242f9c6de699', 'volume_name': 'volume-f7512488-a462-4dd4-9065-242f9c6de699', 'volume_size': 1, 'snapshot_id': '935782b4-4c80-40d4-9e9a-50590d5d3173'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9f0798-3566-4b7b-8966-cd696bbf3a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9f0798-3566-4b7b-8966-cd696bbf3a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9f8b4c-5918-47d6-870a-6d5f354b6ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Volume f7512488-a462-4dd4-9065-242f9c6de699: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7512488-a462-4dd4-9065-242f9c6de699', 'volume_size': 1, 'snapshot_id': '935782b4-4c80-40d4-9e9a-50590d5d3173'} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-quobyte-935782b4-4c80-40d4-9e9a-50590d5d3173-f7512488-a462-4dd4-9065-242f9c6de699" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-935782b4-4c80-40d4-9e9a-50590d5d3173-f7512488-a462-4dd4-9065-242f9c6de699" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Creating volume f7512488-a462-4dd4-9065-242f9c6de699 from snapshot 935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-quobyte-f7512488-a462-4dd4-9065-242f9c6de699" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-f7512488-a462-4dd4-9065-242f9c6de699" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] snapshot: 935782b4-4c80-40d4-9e9a-50590d5d3173, volume: f7512488-a462-4dd4-9065-242f9c6de699, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-9edfa7f1-b398-4818-befd-448ba18d099b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba092e-f33b-4590-8617-30cbbf4f99d1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Lock "cinder-9edfa7f1-b398-4818-befd-448ba18d099b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-quobyte-9edfa7f1-b398-4818-befd-448ba18d099b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-9edfa7f1-b398-4818-befd-448ba18d099b" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59d7e72-f5d1-4755-80d2-5087f9e3679e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[112244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 Aug 25 07:06:50 devstack sudo[112244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b Aug 25 07:06:50 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:50 devstack sudo[112244]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173" returned: 0 in 0.404s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c588c-8fff-4e90-8e13-e690f6bb08c4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:50 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b" returned: 0 in 0.396s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:51 devstack sudo[112256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b Aug 25 07:06:51 devstack sudo[112256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack sudo[112253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 Aug 25 07:06:51 devstack sudo[112253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack sudo[112256]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9edfa7f1-b398-4818-befd-448ba18d099b" returned: 0 in 0.278s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-9edfa7f1-b398-4818-befd-448ba18d099b" released by "delete_volume" :: held 0.714s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Created reservations ['191910df-2280-488d-a4da-52b3ce429049', '16f4c985-b28e-488b-909b-e6e819bf8feb', 'bb6ea7a8-40ab-4303-8677-dae6ba52c038', 'c32476e1-8951-44f3-ae7c-08111f2c2304'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:06:51 devstack sudo[112253]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:51 devstack sudo[112266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 Aug 25 07:06:51 devstack sudo[112266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:51 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:06:51 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:51 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.291s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:06:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Deleted volume successfully. Aug 25 07:06:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3e7ea8ea-a5e0-424e-9d7b-b2ab191627b4 tempest-ProjectReaderTests-188255501 None] Lock "cinder-9edfa7f1-b398-4818-befd-448ba18d099b-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (154480e1-5f55-408e-9c5a-d95d13ddcd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ec3df1-eea1-4ca9-9a8d-1e75339890a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ec3df1-eea1-4ca9-9a8d-1e75339890a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096190004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70025df0-0bec-4937-8681-cb5ec4c9d82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:53Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b23a63-5756-4314-9434-15387965c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b23a63-5756-4314-9434-15387965c890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee9a749-e734-435c-814e-8ced77bdd3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee9a749-e734-435c-814e-8ced77bdd3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70025df0-0bec-4937-8681-cb5ec4c9d82c', 'volume_name': 'volume-70025df0-0bec-4937-8681-cb5ec4c9d82c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe054e48-7581-48b4-b982-3ca56138ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe054e48-7581-48b4-b982-3ca56138ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacaa781-4403-46e4-9216-7914a85a6f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Volume 70025df0-0bec-4937-8681-cb5ec4c9d82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70025df0-0bec-4937-8681-cb5ec4c9d82c', 'volume_size': 1} Aug 25 07:06:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:57 devstack sudo[112266]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699" returned: 0 in 5.942s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:06:57 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Converted 1024.00 MB image at 172.29 MB/s Aug 25 07:06:57 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 is being set with open permissions: ugo+rw Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:57 devstack sudo[112293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 Aug 25 07:06:57 devstack sudo[112293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:57 devstack sudo[112293]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699" returned: 0 in 0.264s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-f7512488-a462-4dd4-9065-242f9c6de699" released by "_copy_volume_from_snapshot" :: held 7.174s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-935782b4-4c80-40d4-9e9a-50590d5d3173-f7512488-a462-4dd4-9065-242f9c6de699" released by "_create_volume_from_snapshot" :: held 7.248s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.272s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.198s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096190004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70025df0-0bec-4937-8681-cb5ec4c9d82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:06:53Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Creating volume 70025df0-0bec-4937-8681-cb5ec4c9d82c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:06:57 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:57 devstack sudo[112300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c 1073741824 Aug 25 07:06:57 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9f8b4c-5918-47d6-870a-6d5f354b6ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7512488-a462-4dd4-9065-242f9c6de699', 'volume_size': 1, 'snapshot_id': '935782b4-4c80-40d4-9e9a-50590d5d3173'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d64630b-a8fc-4655-818e-75784694cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:57 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Volume volume-f7512488-a462-4dd4-9065-242f9c6de699 (f7512488-a462-4dd4-9065-242f9c6de699): created successfully Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d64630b-a8fc-4655-818e-75784694cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Flow 'volume_create_manager' (7fa56354-186c-4b16-963c-b7c7797ba95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1ba946bb-9a9d-4b7b-878a-2c4f29e6d43e tempest-TestStampPattern-746667222 None] Created volume successfully. Aug 25 07:06:58 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c 1073741824" returned: 0 in 0.546s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:58 devstack sudo[112318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c Aug 25 07:06:58 devstack sudo[112318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:58 devstack sudo[112318]: pam_unix(sudo:session): session closed for user root Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacaa781-4403-46e4-9216-7914a85a6f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70025df0-0bec-4937-8681-cb5ec4c9d82c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5518c66c-544c-40fb-911e-5b70a98571c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:06:58 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Volume volume-70025df0-0bec-4937-8681-cb5ec4c9d82c (70025df0-0bec-4937-8681-cb5ec4c9d82c): created successfully Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5518c66c-544c-40fb-911e-5b70a98571c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:06:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (154480e1-5f55-408e-9c5a-d95d13ddcd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:06:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fa450d42-ddaf-499a-bd06-b800fb2333ea tempest-ProjectReaderTests-188255501 None] Created volume successfully. Aug 25 07:06:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-70025df0-0bec-4937-8681-cb5ec4c9d82c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Lock "cinder-70025df0-0bec-4937-8681-cb5ec4c9d82c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-quobyte-70025df0-0bec-4937-8681-cb5ec4c9d82c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:06:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-70025df0-0bec-4937-8681-cb5ec4c9d82c" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:06:59 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5476b71-867b-4f0b-9c5c-3c4a21dfecf5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:06:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:06:59 devstack sudo[112375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c Aug 25 07:06:59 devstack sudo[112375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:06:59 devstack sudo[112375]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c" returned: 0 in 0.390s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:00 devstack sudo[112382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c Aug 25 07:07:00 devstack sudo[112382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack sudo[112382]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70025df0-0bec-4937-8681-cb5ec4c9d82c" returned: 0 in 0.244s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-70025df0-0bec-4937-8681-cb5ec4c9d82c" released by "delete_volume" :: held 0.684s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Created reservations ['46bb0c79-08e1-4862-862a-ba6affa058eb', 'b9015869-0eb1-4d85-9a5b-a156d662a40c', '2c061fef-b60f-4dce-ad2d-acc95c078e71', '9006f6a2-104a-40c5-8b32-b95d4c0397e5'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:00 devstack sudo[112385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:07:00 devstack sudo[112385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:00 devstack sudo[112385]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.418s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Deleted volume successfully. Aug 25 07:07:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-cc040988-7287-4902-9b8e-59945c3c2a70 tempest-ProjectReaderTests-188255501 None] Lock "cinder-70025df0-0bec-4937-8681-cb5ec4c9d82c-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (00ea071f-55e5-43e0-9f88-08478b91b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd20d51-3bda-4461-864f-ffecc012ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd20d51-3bda-4461-864f-ffecc012ccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1806228502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ef96dd-f433-4d68-a21b-f0eb0bcdd732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:01Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c9b55d-2356-4d00-95b1-f0120c4c8db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c9b55d-2356-4d00-95b1-f0120c4c8db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e97240-673a-40ed-9b14-0e85cd527fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e97240-673a-40ed-9b14-0e85cd527fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ef96dd-f433-4d68-a21b-f0eb0bcdd732', 'volume_name': 'volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b84a0a-96fd-4016-8220-020bc618b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b84a0a-96fd-4016-8220-020bc618b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121a3ae9-b558-4871-add1-e2f9cf28dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:01 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Volume b3ef96dd-f433-4d68-a21b-f0eb0bcdd732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732', 'volume_size': 1} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1806228502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ef96dd-f433-4d68-a21b-f0eb0bcdd732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:01Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Creating volume b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:01 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:01 devstack sudo[112390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 1073741824 Aug 25 07:07:01 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:01 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 1073741824" returned: 0 in 0.501s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:02 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 Aug 25 07:07:02 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:02 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121a3ae9-b558-4871-add1-e2f9cf28dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e531ccd4-168d-48b5-997c-7b9be7be77ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Volume volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 (b3ef96dd-f433-4d68-a21b-f0eb0bcdd732): created successfully Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e531ccd4-168d-48b5-997c-7b9be7be77ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (00ea071f-55e5-43e0-9f88-08478b91b85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-744991a8-0fc4-4e9c-903e-a1980a8af04d tempest-ProjectReaderTests-188255501 None] Created volume successfully. Aug 25 07:07:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Lock "cinder-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-quobyte-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c114bf07-ee23-46a7-a8f1-f2215ff98b61]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:03 devstack sudo[112401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 Aug 25 07:07:03 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732" returned: 0 in 0.417s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:04 devstack sudo[112406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732 Aug 25 07:07:04 devstack sudo[112406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack sudo[112406]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732" returned: 0 in 0.277s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732" released by "delete_volume" :: held 0.756s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Created reservations ['3a1ec937-fd42-4ff2-81a9-edc9e1c7eb42', 'a1fcc5ac-0e20-40bd-b3ee-0eec9381b0e7', '571b43af-5df9-4c38-8262-c2e2d3856b2e', 'fc5d0e7b-8a05-4aa3-aa30-f93fb8b2af86'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:04 devstack sudo[112409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:07:04 devstack sudo[112409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:04 devstack sudo[112409]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.254s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Deleted volume successfully. Aug 25 07:07:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d3276635-c0c4-4dd8-8395-bb1d64fa373b tempest-ProjectReaderTests-188255501 None] Lock "cinder-b3ef96dd-f433-4d68-a21b-f0eb0bcdd732-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (b906a696-3aa8-4b5d-b6eb-f422c64410d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf965fa-3234-49b0-b3fa-8c26c47f93bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf965fa-3234-49b0-b3fa-8c26c47f93bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335679067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a766e1a9-2677-4535-a919-e1eddfbecd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:05Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810e0228-4b76-4061-ac97-8924d1b66b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810e0228-4b76-4061-ac97-8924d1b66b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda9f058-a74c-4e83-9781-5118082eba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda9f058-a74c-4e83-9781-5118082eba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a766e1a9-2677-4535-a919-e1eddfbecd7f', 'volume_name': 'volume-a766e1a9-2677-4535-a919-e1eddfbecd7f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dbc461-6a1c-4ae9-a336-529973d862de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dbc461-6a1c-4ae9-a336-529973d862de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ea4529-4c2f-4fbc-88fb-7457326ab7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:05 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Volume a766e1a9-2677-4535-a919-e1eddfbecd7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a766e1a9-2677-4535-a919-e1eddfbecd7f', 'volume_size': 1} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335679067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a766e1a9-2677-4535-a919-e1eddfbecd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b5c3748724f24a1c713caf4f7d6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:07:05Z,use_quota=True,user_id='7f09f43a30c6410bb7f1ab6f89eea44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Creating volume a766e1a9-2677-4535-a919-e1eddfbecd7f {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:07:05 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:05 devstack sudo[112412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f 1073741824 Aug 25 07:07:05 devstack sudo[112412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:05 devstack sudo[112412]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f 1073741824" returned: 0 in 0.402s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:05 devstack sudo[112417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f Aug 25 07:07:05 devstack sudo[112417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:06 devstack sudo[112417]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f" returned: 0 in 0.258s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ea4529-4c2f-4fbc-88fb-7457326ab7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a766e1a9-2677-4535-a919-e1eddfbecd7f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874d43d4-ff3d-407d-a1d5-4d4776a928ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:07:06 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Volume volume-a766e1a9-2677-4535-a919-e1eddfbecd7f (a766e1a9-2677-4535-a919-e1eddfbecd7f): created successfully Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874d43d4-ff3d-407d-a1d5-4d4776a928ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:07:06 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Flow 'volume_create_manager' (b906a696-3aa8-4b5d-b6eb-f422c64410d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:07:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4b2cd6b8-b6aa-4b10-ac7b-1840ac09050d tempest-ProjectReaderTests-188255501 None] Created volume successfully. Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-a766e1a9-2677-4535-a919-e1eddfbecd7f-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Lock "cinder-a766e1a9-2677-4535-a919-e1eddfbecd7f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Acquiring lock "cinder-quobyte-a766e1a9-2677-4535-a919-e1eddfbecd7f" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-a766e1a9-2677-4535-a919-e1eddfbecd7f" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[866e30b2-0830-4d2e-bbdf-3eb37410ac6a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:07 devstack sudo[112420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f Aug 25 07:07:07 devstack sudo[112420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:07 devstack sudo[112420]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f" returned: 0 in 0.380s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:07 devstack sudo[112426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f Aug 25 07:07:07 devstack sudo[112426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:08 devstack sudo[112426]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a766e1a9-2677-4535-a919-e1eddfbecd7f" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Lock "cinder-quobyte-a766e1a9-2677-4535-a919-e1eddfbecd7f" released by "delete_volume" :: held 0.675s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Created reservations ['10994f5a-b321-4f06-b5ea-25f920111a60', 'ea6c943f-4e04-41b7-995d-2d14616a229c', 'ce575582-6978-4935-a108-197868f8f792', '82b6fe5f-4d54-42cc-a6ab-a7303d2186c0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:08 devstack sudo[112429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:07:08 devstack sudo[112429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:08 devstack sudo[112429]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.250s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Deleted volume successfully. Aug 25 07:07:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f85cabaa-b4a5-463d-a7a4-2401f7b61d7f tempest-ProjectReaderTests-188255501 None] Lock "cinder-a766e1a9-2677-4535-a919-e1eddfbecd7f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:18 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=104,cinder:INSERT=32,cinder:UPDATE=118,cinder:DELETE=10 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:07:18 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=140,cinder:SELECT=92,cinder:INSERT=35,cinder:DELETE=14 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:31 devstack sudo[112498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:07:31 devstack sudo[112498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:32 devstack sudo[112498]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.232s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:07:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:07:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:07:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-00a1ffc8-ab9c-4569-82c5-5051275daebc req-60c0c949-4458-416c-bbb8-977aa1d7796b tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-00a1ffc8-ab9c-4569-82c5-5051275daebc req-60c0c949-4458-416c-bbb8-977aa1d7796b tempest-TestStampPattern-746667222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [req-00a1ffc8-ab9c-4569-82c5-5051275daebc req-60c0c949-4458-416c-bbb8-977aa1d7796b tempest-TestStampPattern-746667222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-00a1ffc8-ab9c-4569-82c5-5051275daebc req-60c0c949-4458-416c-bbb8-977aa1d7796b tempest-TestStampPattern-746667222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b', 'name': 'volume-f7512488-a462-4dd4-9065-242f9c6de699', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80e3c664-d868-4bed-9a7b-cf882bcd94bb', 'enforce_multipath': True} {{(pid=94460) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4946}} Aug 25 07:07:40 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-00a1ffc8-ab9c-4569-82c5-5051275daebc req-60c0c949-4458-416c-bbb8-977aa1d7796b tempest-TestStampPattern-746667222 None] attachment_update completed successfully. Aug 25 07:07:42 devstack cinder-volume[94460]: INFO cinder.volume.manager [req-bb0cf06a-4876-48d8-af09-c235e6b6c3ca req-50875fd2-5891-4523-a388-88e2492c905e tempest-TestStampPattern-746667222 None] Terminate volume connection completed successfully. Aug 25 07:07:42 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [req-bb0cf06a-4876-48d8-af09-c235e6b6c3ca req-50875fd2-5891-4523-a388-88e2492c905e tempest-TestStampPattern-746667222 None] Deleting attachment 80e3c664-d868-4bed-9a7b-cf882bcd94bb. {{(pid=94460) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5077}} Aug 25 07:07:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-f7512488-a462-4dd4-9065-242f9c6de699-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Lock "cinder-f7512488-a462-4dd4-9065-242f9c6de699-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-quobyte-f7512488-a462-4dd4-9065-242f9c6de699" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-f7512488-a462-4dd4-9065-242f9c6de699" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe1ce0e-85bc-4b1b-a2b3-d5623fb2d0d6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:47 devstack sudo[112985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 Aug 25 07:07:47 devstack sudo[112985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:47 devstack sudo[112985]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699" returned: 0 in 0.349s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:47 devstack sudo[112990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699 Aug 25 07:07:47 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:47 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f7512488-a462-4dd4-9065-242f9c6de699" returned: 0 in 0.228s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-f7512488-a462-4dd4-9065-242f9c6de699" released by "delete_volume" :: held 0.614s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Created reservations ['45330a9a-2ed9-4971-b1cf-f559747d4bc1', '25590e4e-7485-4d76-9376-32f1cad4c350', 'a9dd769b-fb5c-4045-85c3-affbf6f30f3d', 'b5436d88-d322-4383-a5ac-a637d9268e26'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:47 devstack sudo[112993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:07:47 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:47 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Deleted volume successfully. Aug 25 07:07:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f7c0f277-2121-47f1-95b2-ca45803beacc tempest-TestStampPattern-746667222 None] Lock "cinder-f7512488-a462-4dd4-9065-242f9c6de699-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-935782b4-4c80-40d4-9e9a-50590d5d3173-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Lock "cinder-935782b4-4c80-40d4-9e9a-50590d5d3173-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-quobyte-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-quobyte-935782b4-4c80-40d4-9e9a-50590d5d3173" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-935782b4-4c80-40d4-9e9a-50590d5d3173" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Deleting offline snapshot 935782b4-4c80-40d4-9e9a-50590d5d3173 of volume d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] snapshot_file for this snap is: volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0de464e-877e-42b8-8a96-7029d405553c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:48 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 Aug 25 07:07:48 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:48 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173" returned: 0 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bec8a0-b5d2-42d5-b3d2-f1227cb95a43]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:48 devstack sudo[113003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 Aug 25 07:07:48 devstack sudo[113003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:49 devstack sudo[113003]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" returned: 0 in 0.500s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:49 devstack sudo[113008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 Aug 25 07:07:49 devstack sudo[113008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:49 devstack sudo[113008]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173" returned: 0 in 0.323s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:49 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173 Aug 25 07:07:49 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:49 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401.935782b4-4c80-40d4-9e9a-50590d5d3173" returned: 0 in 0.238s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-935782b4-4c80-40d4-9e9a-50590d5d3173" released by "_delete_snapshot" :: held 1.503s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" released by "delete_snapshot" :: held 1.532s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Created reservations ['a1eda2fa-f553-4357-a6b5-70783ec84ddb', '5e1d9693-d26c-4170-8703-aba5c8fdc78f', '97c57edf-f21c-46af-a744-3e3bd16b74e1', '1d9c9aba-155e-437b-b6ba-48c8544dd69e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Delete snapshot completed successfully. Aug 25 07:07:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-378753ac-bbae-4171-85e0-09f08ed9bc55 tempest-TestStampPattern-746667222 None] Lock "cinder-935782b4-4c80-40d4-9e9a-50590d5d3173-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Lock "cinder-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Acquiring lock "cinder-quobyte-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:07:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:07:53 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5779cad-30d0-4222-813c-363c3d579099]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:07:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack sudo[113047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 Aug 25 07:07:54 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack sudo[113052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401 Aug 25 07:07:54 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" returned: 0 in 0.259s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Lock "cinder-quobyte-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401" released by "delete_volume" :: held 0.677s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Created reservations ['72f6187b-2c7a-451e-b30d-5d2874cf3533', '00da12d4-63aa-4f16-be1b-762c168df457', '6e768832-a32e-4c5e-b06a-dfaf759180d1', 'c008f412-2c39-4409-854c-f4bbc0c4da96'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:07:54 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:07:54 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:07:54 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:07:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Deleted volume successfully. Aug 25 07:07:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-882438d8-cc23-4066-94e9-98a4f2615fef tempest-TestStampPattern-746667222 None] Lock "cinder-d52d6bd3-9ccb-45c7-90b9-ff18bf5cf401-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:04 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:08:04 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (d07328b0-2717-4ee9-b3a7-1554300a1467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7accc83b-d7e9-4507-8f1b-584332aad44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7accc83b-d7e9-4507-8f1b-584332aad44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118850330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:07Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f93f9b4-cfad-4207-bab3-70550db0e191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f93f9b4-cfad-4207-bab3-70550db0e191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3859fb-21c4-48ff-80e3-a42b02289486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3859fb-21c4-48ff-80e3-a42b02289486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1', 'volume_name': 'volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7432b95f-472f-42f0-9bd8-ec8d6aceab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7432b95f-472f-42f0-9bd8-ec8d6aceab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1644c8a2-5d73-4912-87a7-4cf6bbc10743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Volume 8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1', 'volume_size': 1} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118850330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:07Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Creating volume 8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:07 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:07 devstack sudo[113067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 1073741824 Aug 25 07:08:07 devstack sudo[113067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (c17435a0-aa63-4886-bc6d-96e3a0e3cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5f3225-9a03-4738-ac2b-7537e807681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5f3225-9a03-4738-ac2b-7537e807681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1123070162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9145f06-836c-4772-be59-cc051784d390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:08Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b35163-ee55-4243-b33d-0da3ee591757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b35163-ee55-4243-b33d-0da3ee591757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05634a18-9ac1-4098-a6d3-a010ef4ae5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05634a18-9ac1-4098-a6d3-a010ef4ae5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9145f06-836c-4772-be59-cc051784d390', 'volume_name': 'volume-d9145f06-836c-4772-be59-cc051784d390', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad05407b-0464-4e4b-bfd7-4f6e476e5f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad05407b-0464-4e4b-bfd7-4f6e476e5f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f944cd17-7990-4619-aac4-76b863a2054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Volume d9145f06-836c-4772-be59-cc051784d390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9145f06-836c-4772-be59-cc051784d390', 'volume_size': 1} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:08 devstack sudo[113067]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 1073741824" returned: 0 in 0.485s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:08 devstack sudo[113073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 Aug 25 07:08:08 devstack sudo[113073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (0a336bd0-b5ad-413a-8785-72cc68a9d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b973eda-4d79-47dc-99bb-0dc2fb2a0327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b973eda-4d79-47dc-99bb-0dc2fb2a0327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-39805247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d66a4a-7a63-4bb0-a46e-337190d62074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:08Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6609151c-f79e-4d35-ae45-01069c294e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6609151c-f79e-4d35-ae45-01069c294e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb950e3-6968-4110-b4bc-5bd30e1c704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb950e3-6968-4110-b4bc-5bd30e1c704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d66a4a-7a63-4bb0-a46e-337190d62074', 'volume_name': 'volume-12d66a4a-7a63-4bb0-a46e-337190d62074', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449b1a10-dd36-42b3-989b-524702445c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449b1a10-dd36-42b3-989b-524702445c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d657ae8-040c-4363-8408-be5a2cdeaab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Volume 12d66a4a-7a63-4bb0-a46e-337190d62074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d66a4a-7a63-4bb0-a46e-337190d62074', 'volume_size': 1} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:08 devstack sudo[113073]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1" returned: 0 in 0.266s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1123070162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9145f06-836c-4772-be59-cc051784d390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:08Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Creating volume d9145f06-836c-4772-be59-cc051784d390 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:08 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1644c8a2-5d73-4912-87a7-4cf6bbc10743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5566c75b-5204-425e-b7a1-697051ef6c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack sudo[113076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 1073741824 Aug 25 07:08:08 devstack sudo[113076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Volume volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 (8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1): created successfully Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5566c75b-5204-425e-b7a1-697051ef6c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (d07328b0-2717-4ee9-b3a7-1554300a1467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7b477057-9df7-48dd-86a1-c188a15b746a tempest-CreateVolumesFromImageTest-118935097 None] Created volume successfully. Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (ce54d025-32e6-4297-b2ad-0fae5c506aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15e1555-03ec-4e48-a0c6-73d3ab37a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15e1555-03ec-4e48-a0c6-73d3ab37a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1352589953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566b5cbc-290c-43d3-9c2d-d9217e465056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:09Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c12fc-ac96-4d81-8cdd-6210a52797f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c12fc-ac96-4d81-8cdd-6210a52797f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95f6a2c-c54a-4574-95ed-149843459105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95f6a2c-c54a-4574-95ed-149843459105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566b5cbc-290c-43d3-9c2d-d9217e465056', 'volume_name': 'volume-566b5cbc-290c-43d3-9c2d-d9217e465056', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533ecc6b-890d-45d5-81e9-aeb605bd9331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533ecc6b-890d-45d5-81e9-aeb605bd9331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b91cc3d-2155-4c40-8321-21798f1126cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Volume 566b5cbc-290c-43d3-9c2d-d9217e465056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566b5cbc-290c-43d3-9c2d-d9217e465056', 'volume_size': 1} Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:08 devstack sudo[113076]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 1073741824" returned: 0 in 0.518s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:09 devstack sudo[113082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 Aug 25 07:08:09 devstack sudo[113082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (40dca63b-71e8-4523-978e-e7ef196457a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb1467b-b928-4979-837b-0154fb8b1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb1467b-b928-4979-837b-0154fb8b1d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1239376353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d83435-c781-47ab-8eec-04c32f76801a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:09Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa03303-436f-4962-9200-69f5bb2aab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa03303-436f-4962-9200-69f5bb2aab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff77c5d-b372-4d8b-a5f8-fa9ad5b217b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff77c5d-b372-4d8b-a5f8-fa9ad5b217b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d83435-c781-47ab-8eec-04c32f76801a', 'volume_name': 'volume-a4d83435-c781-47ab-8eec-04c32f76801a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3c9781-3e7f-45e9-98b0-04575f629179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3c9781-3e7f-45e9-98b0-04575f629179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd45db2-06cf-4e9f-b8eb-0b231fb1270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Volume a4d83435-c781-47ab-8eec-04c32f76801a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d83435-c781-47ab-8eec-04c32f76801a', 'volume_size': 1} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:09 devstack sudo[113082]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390" returned: 0 in 0.257s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-39805247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d66a4a-7a63-4bb0-a46e-337190d62074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:08Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Creating volume 12d66a4a-7a63-4bb0-a46e-337190d62074 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:09 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f944cd17-7990-4619-aac4-76b863a2054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9145f06-836c-4772-be59-cc051784d390', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack sudo[113085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 1073741824 Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe94c51-e459-4e24-aaf5-13a1449a8379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack sudo[113085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:09 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Volume volume-d9145f06-836c-4772-be59-cc051784d390 (d9145f06-836c-4772-be59-cc051784d390): created successfully Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe94c51-e459-4e24-aaf5-13a1449a8379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (c17435a0-aa63-4886-bc6d-96e3a0e3cde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5debcc72-6228-4efd-8aac-cfd77dbf3b6a tempest-CreateVolumesFromImageTest-118935097 None] Created volume successfully. Aug 25 07:08:09 devstack sudo[113085]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 1073741824" returned: 0 in 0.397s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:09 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 Aug 25 07:08:09 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:09 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1352589953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566b5cbc-290c-43d3-9c2d-d9217e465056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:09Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Creating volume 566b5cbc-290c-43d3-9c2d-d9217e465056 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:09 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d657ae8-040c-4363-8408-be5a2cdeaab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d66a4a-7a63-4bb0-a46e-337190d62074', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 1073741824 Aug 25 07:08:09 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fda69b5-02d0-4fcd-91f6-bd9b98bff69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:09 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Volume volume-12d66a4a-7a63-4bb0-a46e-337190d62074 (12d66a4a-7a63-4bb0-a46e-337190d62074): created successfully Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fda69b5-02d0-4fcd-91f6-bd9b98bff69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:09 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (0a336bd0-b5ad-413a-8785-72cc68a9d18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:10 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-364f0549-d697-4980-83ab-ed6ca6b4a12d tempest-CreateVolumesFromImageTest-118935097 None] Created volume successfully. Aug 25 07:08:10 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 1073741824" returned: 0 in 0.428s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:10 devstack sudo[113101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 Aug 25 07:08:10 devstack sudo[113101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:10 devstack sudo[113101]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056" returned: 0 in 0.227s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1239376353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d83435-c781-47ab-8eec-04c32f76801a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c838b8fa942ffa969ef288111b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:09Z,use_quota=True,user_id='2a2ff73e81e74256ac9d3c6d2c3433c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Creating volume a4d83435-c781-47ab-8eec-04c32f76801a {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:10 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:10 devstack sudo[113104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a 1073741824 Aug 25 07:08:10 devstack sudo[113104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b91cc3d-2155-4c40-8321-21798f1126cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566b5cbc-290c-43d3-9c2d-d9217e465056', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c2b6b2-1223-447b-aa20-acc998a04437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:10 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Volume volume-566b5cbc-290c-43d3-9c2d-d9217e465056 (566b5cbc-290c-43d3-9c2d-d9217e465056): created successfully Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c2b6b2-1223-447b-aa20-acc998a04437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (ce54d025-32e6-4297-b2ad-0fae5c506aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:10 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ecd3f7f2-7c2c-4502-a77f-2b6e48e3c87f tempest-CreateVolumesFromImageTest-118935097 None] Created volume successfully. Aug 25 07:08:11 devstack sudo[113104]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a 1073741824" returned: 0 in 0.410s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:11 devstack sudo[113109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a Aug 25 07:08:11 devstack sudo[113109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:11 devstack sudo[113109]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd45db2-06cf-4e9f-b8eb-0b231fb1270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d83435-c781-47ab-8eec-04c32f76801a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5718ae3-d6e6-4de4-8f27-4be70c3d5f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Volume volume-a4d83435-c781-47ab-8eec-04c32f76801a (a4d83435-c781-47ab-8eec-04c32f76801a): created successfully Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5718ae3-d6e6-4de4-8f27-4be70c3d5f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Flow 'volume_create_manager' (40dca63b-71e8-4523-978e-e7ef196457a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a5361082-272c-49fd-8834-4df8e70c1ce5 tempest-CreateVolumesFromImageTest-118935097 None] Created volume successfully. Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-a4d83435-c781-47ab-8eec-04c32f76801a-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-a4d83435-c781-47ab-8eec-04c32f76801a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-quobyte-a4d83435-c781-47ab-8eec-04c32f76801a" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-a4d83435-c781-47ab-8eec-04c32f76801a" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f623be4f-5b55-417e-94aa-efa521e22b74]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:12 devstack sudo[113112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a Aug 25 07:08:12 devstack sudo[113112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:12 devstack sudo[113112]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a" returned: 0 in 0.334s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:12 devstack sudo[113117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a Aug 25 07:08:12 devstack sudo[113117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:13 devstack sudo[113117]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a4d83435-c781-47ab-8eec-04c32f76801a" returned: 0 in 0.238s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-a4d83435-c781-47ab-8eec-04c32f76801a" released by "delete_volume" :: held 0.607s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Created reservations ['b840ddf6-0f73-42c6-a102-b0a871a1b864', '664108ae-c9c0-4db7-869d-d8d0be986a06', 'fcbe68b5-8112-47af-8c63-237e31c460d3', '3d251313-b56c-47e6-a46c-c28de636299d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:13 devstack sudo[113120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:13 devstack sudo[113120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:13 devstack sudo[113120]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.227s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Deleted volume successfully. Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f0aa1775-ad60-4600-af02-414939d01b00 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-a4d83435-c781-47ab-8eec-04c32f76801a-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-566b5cbc-290c-43d3-9c2d-d9217e465056-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-566b5cbc-290c-43d3-9c2d-d9217e465056-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-quobyte-566b5cbc-290c-43d3-9c2d-d9217e465056" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-566b5cbc-290c-43d3-9c2d-d9217e465056" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbe82d1-6090-4a09-805c-571e0339f7f9]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:13 devstack sudo[113123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 Aug 25 07:08:13 devstack sudo[113123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:14 devstack sudo[113123]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:14 devstack sudo[113128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056 Aug 25 07:08:14 devstack sudo[113128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:14 devstack sudo[113128]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-566b5cbc-290c-43d3-9c2d-d9217e465056" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-566b5cbc-290c-43d3-9c2d-d9217e465056" released by "delete_volume" :: held 0.613s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Created reservations ['c48f6109-bb21-46fd-be33-de512873acce', '8b738da4-1f3a-44b0-abed-72f009071ac5', '154df859-b389-49ef-a4e7-37879555bfd9', '33c3c3a3-1fac-4c4b-a53b-cffd03235b79'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:14 devstack sudo[113131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:14 devstack sudo[113131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:14 devstack sudo[113131]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:14 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Deleted volume successfully. Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6df39568-fab6-4e93-bd89-98bee0b81064 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-566b5cbc-290c-43d3-9c2d-d9217e465056-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-12d66a4a-7a63-4bb0-a46e-337190d62074-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-12d66a4a-7a63-4bb0-a46e-337190d62074-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-quobyte-12d66a4a-7a63-4bb0-a46e-337190d62074" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-12d66a4a-7a63-4bb0-a46e-337190d62074" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7068285c-bac6-4227-9120-e4279e9c2011]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:14 devstack sudo[113134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 Aug 25 07:08:14 devstack sudo[113134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:15 devstack sudo[113134]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:15 devstack sudo[113139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074 Aug 25 07:08:15 devstack sudo[113139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:15 devstack sudo[113139]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-12d66a4a-7a63-4bb0-a46e-337190d62074" returned: 0 in 0.237s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-12d66a4a-7a63-4bb0-a46e-337190d62074" released by "delete_volume" :: held 0.613s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Created reservations ['5c7d1025-8768-4004-aaef-8db8b3cd7a2d', 'c3ef2e82-1436-4df9-a5ed-9ac2712c1596', '671a87b8-3af9-4492-841b-07e0d3e82e84', '0bc140ec-e4b1-4ea6-83a7-c6522c5aa346'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:15 devstack sudo[113144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:15 devstack sudo[113144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:15 devstack sudo[113144]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Deleted volume successfully. Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0037be84-9a38-4607-971b-45fc179e417d tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-12d66a4a-7a63-4bb0-a46e-337190d62074-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-d9145f06-836c-4772-be59-cc051784d390-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-d9145f06-836c-4772-be59-cc051784d390-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-quobyte-d9145f06-836c-4772-be59-cc051784d390" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-d9145f06-836c-4772-be59-cc051784d390" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d49bf-d91e-47d6-8837-b70bcf57e813]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:16 devstack sudo[113147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 Aug 25 07:08:16 devstack sudo[113147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack sudo[113147]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:16 devstack sudo[113152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390 Aug 25 07:08:16 devstack sudo[113152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack sudo[113152]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d9145f06-836c-4772-be59-cc051784d390" returned: 0 in 0.231s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-d9145f06-836c-4772-be59-cc051784d390" released by "delete_volume" :: held 0.610s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Created reservations ['5794b6d1-5eff-4ac5-b66d-c43d51a1845a', '44e7cf9b-0b10-4f9a-9468-7109a94fb520', '2b271a92-301c-4f02-be68-05ec95f25575', '2ea81e25-839a-41dc-b5a3-9fc780731f53'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:16 devstack sudo[113155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:16 devstack sudo[113155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:16 devstack sudo[113155]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Deleted volume successfully. Aug 25 07:08:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df345e67-bc8a-4f04-a2c7-0fe9b514ba05 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-d9145f06-836c-4772-be59-cc051784d390-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "cinder-quobyte-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e5662-e534-467b-87e0-162039e8d48f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 Aug 25 07:08:17 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:17 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1" returned: 0 in 0.340s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[113163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1 Aug 25 07:08:17 devstack sudo[113163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:17 devstack sudo[113163]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1" returned: 0 in 0.230s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-quobyte-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1" released by "delete_volume" :: held 0.608s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Created reservations ['208f32b3-dcc0-48a9-8207-2b3da55df333', '955a67c2-8e2a-4362-b7e7-ad34732e810b', '47d73644-7123-4e55-bed5-8ea792ee5faf', 'e912bd8d-7d62-4cb2-8184-e5c4be6970b1'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:17 devstack sudo[113166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:17 devstack sudo[113166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:18 devstack sudo[113166]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.234s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:18 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Deleted volume successfully. Aug 25 07:08:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-454863bd-b34c-4691-9609-de3ec21147e3 tempest-CreateVolumesFromImageTest-118935097 None] Lock "cinder-8ad2ba0f-9368-4b9b-8bc1-bd5237579ca1-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Flow 'volume_create_manager' (352fac19-79e2-4ff7-9c11-10f78b874e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2061a91-c335-4786-ae4f-d83fcf241a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2061a91-c335-4786-ae4f-d83fcf241a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1026039007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e93ff83-feea-4b20-b41e-0661c067d593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7921dbe7d4b4e4eacef11c715ce261d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:21Z,use_quota=True,user_id='2577a90830764880affd1ad62f8e3056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7b48ef-7aca-4cde-b448-a48fd049a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7b48ef-7aca-4cde-b448-a48fd049a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a51c1d-c0c8-42fb-9d9f-cae78fb9e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a51c1d-c0c8-42fb-9d9f-cae78fb9e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e93ff83-feea-4b20-b41e-0661c067d593', 'volume_name': 'volume-2e93ff83-feea-4b20-b41e-0661c067d593', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7eb3a9-9763-4497-8424-ce2e310ab4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7eb3a9-9763-4497-8424-ce2e310ab4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68274e-a011-4429-8c4a-d190dc1969ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:20 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Volume 2e93ff83-feea-4b20-b41e-0661c067d593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e93ff83-feea-4b20-b41e-0661c067d593', 'volume_size': 1} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1026039007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e93ff83-feea-4b20-b41e-0661c067d593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7921dbe7d4b4e4eacef11c715ce261d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:21Z,use_quota=True,user_id='2577a90830764880affd1ad62f8e3056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Creating volume 2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:20 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:20 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 1073741824 Aug 25 07:08:20 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:21 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 1073741824" returned: 0 in 0.400s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:21 devstack sudo[113176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 Aug 25 07:08:21 devstack sudo[113176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:21 devstack sudo[113176]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593" returned: 0 in 0.234s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68274e-a011-4429-8c4a-d190dc1969ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e93ff83-feea-4b20-b41e-0661c067d593', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3ac2fb-2891-4c7e-afe0-ae8f25beef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Volume volume-2e93ff83-feea-4b20-b41e-0661c067d593 (2e93ff83-feea-4b20-b41e-0661c067d593): created successfully Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3ac2fb-2891-4c7e-afe0-ae8f25beef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Flow 'volume_create_manager' (352fac19-79e2-4ff7-9c11-10f78b874e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cea7b28f-7d23-449c-892c-8a7b31223a4f tempest-VolumeDependencyTests-298781579 None] Created volume successfully. Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Creating offline snapshot db18055a-746d-4e65-8125-2db2f4d7073b of volume 2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba9a4d3-5e83-4b1f-9626-e38fde59c9b1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:22 devstack sudo[113179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 Aug 25 07:08:22 devstack sudo[113179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:22 devstack sudo[113179]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:22 devstack sudo[113196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b 1G Aug 25 07:08:22 devstack sudo[113196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:22 devstack sudo[113196]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b 1G" returned: 0 in 0.396s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e93ff83-feea-4b20-b41e-0661c067d593 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:22 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e93ff83-feea-4b20-b41e-0661c067d593 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b Aug 25 07:08:22 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:22 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e93ff83-feea-4b20-b41e-0661c067d593 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:22 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b is being set with open permissions: ugo+rw Aug 25 07:08:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:22 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b Aug 25 07:08:22 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b" returned: 0 in 0.229s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:23 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info Aug 25 07:08:23 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info" returned: 0 in 0.239s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info is being set with open permissions: ugo+rw Aug 25 07:08:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:23 devstack sudo[113237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info Aug 25 07:08:23 devstack sudo[113237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:23 devstack sudo[113237]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.info" returned: 0 in 0.227s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-507b8823-ec86-4dd3-9112-a2c0267e33e8 tempest-VolumeDependencyTests-298781579 None] Create snapshot completed successfully Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Flow 'volume_create_manager' (5efcd262-ab69-409b-9431-cff308da3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdad72a-4098-464d-bf10-aafb3e0055e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdad72a-4098-464d-bf10-aafb3e0055e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-838478769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9573da-881d-4c36-b57d-1b89f31b8535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7921dbe7d4b4e4eacef11c715ce261d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db18055a-746d-4e65-8125-2db2f4d7073b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:24Z,use_quota=True,user_id='2577a90830764880affd1ad62f8e3056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffd7e29-02f3-4a41-a98a-df90e4cd48e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffd7e29-02f3-4a41-a98a-df90e4cd48e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa4d088-676a-44f0-a429-2d6ce973599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa4d088-676a-44f0-a429-2d6ce973599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e9573da-881d-4c36-b57d-1b89f31b8535', 'volume_name': 'volume-9e9573da-881d-4c36-b57d-1b89f31b8535', 'volume_size': 1, 'snapshot_id': 'db18055a-746d-4e65-8125-2db2f4d7073b'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d50f735-5ef9-4b9e-b468-3ad32060b953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d50f735-5ef9-4b9e-b468-3ad32060b953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79512564-f3c2-4e5d-849c-2713124abfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:24 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Volume 9e9573da-881d-4c36-b57d-1b89f31b8535: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e9573da-881d-4c36-b57d-1b89f31b8535', 'volume_size': 1, 'snapshot_id': 'db18055a-746d-4e65-8125-2db2f4d7073b'} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-quobyte-db18055a-746d-4e65-8125-2db2f4d7073b-9e9573da-881d-4c36-b57d-1b89f31b8535" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-db18055a-746d-4e65-8125-2db2f4d7073b-9e9573da-881d-4c36-b57d-1b89f31b8535" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Creating volume 9e9573da-881d-4c36-b57d-1b89f31b8535 from snapshot db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-quobyte-9e9573da-881d-4c36-b57d-1b89f31b8535" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-9e9573da-881d-4c36-b57d-1b89f31b8535" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] snapshot: db18055a-746d-4e65-8125-2db2f4d7073b, volume: 9e9573da-881d-4c36-b57d-1b89f31b8535, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c886bbd9-dc6d-4888-a338-7a35564814f1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:24 devstack sudo[113240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b Aug 25 07:08:24 devstack sudo[113240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:24 devstack sudo[113240]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e93ff83-feea-4b20-b41e-0661c067d593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d075c-3f68-4695-b58d-b5bbd9db625e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:25 devstack sudo[113245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 Aug 25 07:08:25 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:25 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593" returned: 0 in 0.333s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:08:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:08:25 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:08:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:25 devstack sudo[113250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 Aug 25 07:08:25 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:29 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535" returned: 0 in 3.890s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593, size 1024.00 MB, duration 3.89 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:08:29 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Converted 1024.00 MB image at 263.13 MB/s Aug 25 07:08:29 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 is being set with open permissions: ugo+rw Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:29 devstack sudo[113263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 Aug 25 07:08:29 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:29 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535" returned: 0 in 0.229s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-9e9573da-881d-4c36-b57d-1b89f31b8535" released by "_copy_volume_from_snapshot" :: held 4.874s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-db18055a-746d-4e65-8125-2db2f4d7073b-9e9573da-881d-4c36-b57d-1b89f31b8535" released by "_create_volume_from_snapshot" :: held 4.931s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.948s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79512564-f3c2-4e5d-849c-2713124abfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9573da-881d-4c36-b57d-1b89f31b8535', 'volume_size': 1, 'snapshot_id': 'db18055a-746d-4e65-8125-2db2f4d7073b'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a902b82-0001-4373-9075-75cb3d149fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:29 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Volume volume-9e9573da-881d-4c36-b57d-1b89f31b8535 (9e9573da-881d-4c36-b57d-1b89f31b8535): created successfully Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a902b82-0001-4373-9075-75cb3d149fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Flow 'volume_create_manager' (5efcd262-ab69-409b-9431-cff308da3acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:29 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5f35915b-e91a-4e26-b4da-bc82988c80d9 tempest-VolumeDependencyTests-298781579 None] Created volume successfully. Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-db18055a-746d-4e65-8125-2db2f4d7073b-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Lock "cinder-db18055a-746d-4e65-8125-2db2f4d7073b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-quobyte-2e93ff83-feea-4b20-b41e-0661c067d593" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-2e93ff83-feea-4b20-b41e-0661c067d593" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-quobyte-db18055a-746d-4e65-8125-2db2f4d7073b" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-db18055a-746d-4e65-8125-2db2f4d7073b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Deleting offline snapshot db18055a-746d-4e65-8125-2db2f4d7073b of volume 2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] snapshot_file for this snap is: volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e318f6-0dc8-4d72-b2e1-26e1ea08abcd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[113267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b Aug 25 07:08:30 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:30 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b" returned: 0 in 0.363s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e93ff83-feea-4b20-b41e-0661c067d593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63ec1c8-77cc-4c9a-a227-783ac77d56d0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[113272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 Aug 25 07:08:30 devstack sudo[113272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:30 devstack sudo[113272]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593" returned: 0 in 0.530s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:30 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b Aug 25 07:08:30 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b" returned: 0 in 0.326s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack sudo[113282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b Aug 25 07:08:31 devstack sudo[113282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:31 devstack sudo[113282]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593.db18055a-746d-4e65-8125-2db2f4d7073b" returned: 0 in 0.230s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-db18055a-746d-4e65-8125-2db2f4d7073b" released by "_delete_snapshot" :: held 1.539s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-2e93ff83-feea-4b20-b41e-0661c067d593" released by "delete_snapshot" :: held 1.560s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Created reservations ['8edd36f4-10a7-41ba-87f2-b18e5c5f9f23', 'a0d70849-b31b-4bb9-893e-db720e73769f', '1e68a8c7-152f-4d93-b499-f93962822c84', 'adbbcfa2-64dc-475d-bba4-abfc988ffaa6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:31 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Delete snapshot completed successfully. Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ea57c309-77e8-4a5b-8f16-610626764d9d tempest-VolumeDependencyTests-298781579 None] Lock "cinder-db18055a-746d-4e65-8125-2db2f4d7073b-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:31 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:31 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:32 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-2e93ff83-feea-4b20-b41e-0661c067d593-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-2e93ff83-feea-4b20-b41e-0661c067d593-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-quobyte-2e93ff83-feea-4b20-b41e-0661c067d593" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-2e93ff83-feea-4b20-b41e-0661c067d593" acquired by "delete_volume" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c1a04b-27c9-4b1d-94c3-7221d0d39ffb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:32 devstack sudo[113288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 Aug 25 07:08:32 devstack sudo[113288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:32 devstack sudo[113288]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593" returned: 0 in 0.367s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:32 devstack sudo[113299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593 Aug 25 07:08:32 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:32 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-2e93ff83-feea-4b20-b41e-0661c067d593" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-2e93ff83-feea-4b20-b41e-0661c067d593" released by "delete_volume" :: held 0.671s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Created reservations ['17f4e2c4-43cc-41d1-86d6-398c165e7563', '6a1ee16f-910d-4b1c-835a-b427f66d1065', '0abdec81-c8e4-48d1-ad5d-c728f12ec0ee', 'aa2e459b-c655-4312-8c32-c4016e859e2e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:32 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:32 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:33 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Deleted volume successfully. Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7ca39d89-72ac-40ad-8044-d81277ea5ec5 tempest-VolumeDependencyTests-298781579 None] Lock "cinder-2e93ff83-feea-4b20-b41e-0661c067d593-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-9e9573da-881d-4c36-b57d-1b89f31b8535-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Lock "cinder-9e9573da-881d-4c36-b57d-1b89f31b8535-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Acquiring lock "cinder-quobyte-9e9573da-881d-4c36-b57d-1b89f31b8535" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-9e9573da-881d-4c36-b57d-1b89f31b8535" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[871c76af-2379-4a95-8bfb-4f1499ef6a10]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack sudo[113305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 Aug 25 07:08:33 devstack sudo[113305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack sudo[113305]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535" returned: 0 in 0.351s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:33 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535 Aug 25 07:08:33 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:33 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9e9573da-881d-4c36-b57d-1b89f31b8535" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Lock "cinder-quobyte-9e9573da-881d-4c36-b57d-1b89f31b8535" released by "delete_volume" :: held 0.622s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:33 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Created reservations ['352449b5-5582-46a2-9e6d-cea333be790e', 'fd904807-329c-417d-9752-ecfffe0f6f95', 'a706b77e-583c-4414-b62f-33e94507594d', '7eba7a0b-c610-41d4-8cbe-74da47c5cb2e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:34 devstack sudo[113313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:34 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:34 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.238s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:34 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Deleted volume successfully. Aug 25 07:08:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2d0a8be8-9981-47a9-add3-33f8b659766e tempest-VolumeDependencyTests-298781579 None] Lock "cinder-9e9573da-881d-4c36-b57d-1b89f31b8535-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Flow 'volume_create_manager' (56274af2-34f2-4913-a5b5-eef6c21878af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94399bb-23cd-44b4-8a35-bc2f4070f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94399bb-23cd-44b4-8a35-bc2f4070f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42f9ad8-a208-4c17-9629-eb1636fb6b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b48b89023f474a9c14bcbc4d522e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:37Z,use_quota=True,user_id='bc9090aa449e41cc8ec48440cff88fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ada3ae2-99be-41f7-9a10-27c97946e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ada3ae2-99be-41f7-9a10-27c97946e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b713613b-473d-42c9-9eb2-053024bfc670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b713613b-473d-42c9-9eb2-053024bfc670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42f9ad8-a208-4c17-9629-eb1636fb6b1d', 'volume_name': 'volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1859d4c-8585-4eb7-b90f-6370f0be0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1859d4c-8585-4eb7-b90f-6370f0be0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e696ca-e6b2-4044-a439-59635786707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Volume d42f9ad8-a208-4c17-9629-eb1636fb6b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d', 'volume_size': 1} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42f9ad8-a208-4c17-9629-eb1636fb6b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b48b89023f474a9c14bcbc4d522e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:37Z,use_quota=True,user_id='bc9090aa449e41cc8ec48440cff88fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Creating volume d42f9ad8-a208-4c17-9629-eb1636fb6b1d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:37 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:37 devstack sudo[113316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d 1073741824 Aug 25 07:08:37 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:37 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d 1073741824" returned: 0 in 0.394s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:37 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d Aug 25 07:08:37 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:37 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d" returned: 0 in 0.245s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e696ca-e6b2-4044-a439-59635786707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6942b117-032f-4c30-bd66-f19afb6ad06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Volume volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d (d42f9ad8-a208-4c17-9629-eb1636fb6b1d): created successfully Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6942b117-032f-4c30-bd66-f19afb6ad06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Flow 'volume_create_manager' (56274af2-34f2-4913-a5b5-eef6c21878af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a41d2508-0c13-4753-9662-545b5b00a31f tempest-CinderUnicodeTest-1535008211 None] Created volume successfully. Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Flow 'volume_create_manager' (fd0b5157-fa9f-4fba-9c74-ab610356c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31c7700-35aa-417d-bf87-2776a1c6f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31c7700-35aa-417d-bf87-2776a1c6f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1737100452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9130117-b065-4909-8830-b67280dfb1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b48b89023f474a9c14bcbc4d522e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:39Z,use_quota=True,user_id='bc9090aa449e41cc8ec48440cff88fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3048bc91-4a89-4f2e-be90-32b612cb3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3048bc91-4a89-4f2e-be90-32b612cb3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc4efe4-59f9-4113-86d3-ab0aaa0d2e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc4efe4-59f9-4113-86d3-ab0aaa0d2e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9130117-b065-4909-8830-b67280dfb1a5', 'volume_name': 'volume-c9130117-b065-4909-8830-b67280dfb1a5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502a4212-703a-4ebf-ae61-8f323c6f0116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502a4212-703a-4ebf-ae61-8f323c6f0116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacb3222-e42e-4673-ad33-05e150d47e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:38 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Volume c9130117-b065-4909-8830-b67280dfb1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9130117-b065-4909-8830-b67280dfb1a5', 'volume_size': 1} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:08:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1737100452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9130117-b065-4909-8830-b67280dfb1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b48b89023f474a9c14bcbc4d522e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:08:39Z,use_quota=True,user_id='bc9090aa449e41cc8ec48440cff88fa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Creating volume c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:08:38 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:08:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:38 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 1073741824 Aug 25 07:08:38 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:39 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 1073741824" returned: 0 in 0.387s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:39 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 Aug 25 07:08:39 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:39 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5" returned: 0 in 0.234s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacb3222-e42e-4673-ad33-05e150d47e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9130117-b065-4909-8830-b67280dfb1a5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de2f896-94f9-480f-98cd-875bba11500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:08:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Volume volume-c9130117-b065-4909-8830-b67280dfb1a5 (c9130117-b065-4909-8830-b67280dfb1a5): created successfully Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de2f896-94f9-480f-98cd-875bba11500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Flow 'volume_create_manager' (fd0b5157-fa9f-4fba-9c74-ab610356c11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:08:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-97e84b50-53ce-42dc-aeb0-6c92e97939c6 tempest-CinderUnicodeTest-1535008211 None] Created volume successfully. Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Creating offline snapshot e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 of volume c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[22242374-6d86-482f-8da1-98122ca8b20d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:39 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 Aug 25 07:08:39 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:40 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:40 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 1G Aug 25 07:08:40 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:40 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 1G" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9130117-b065-4909-8830-b67280dfb1a5 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:40 devstack sudo[113345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9130117-b065-4909-8830-b67280dfb1a5 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 Aug 25 07:08:40 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:40 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9130117-b065-4909-8830-b67280dfb1a5 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" returned: 0 in 0.280s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:40 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 is being set with open permissions: ugo+rw Aug 25 07:08:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:40 devstack sudo[113351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 Aug 25 07:08:40 devstack sudo[113351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:41 devstack sudo[113351]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" returned: 0 in 0.229s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:41 devstack sudo[113354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info Aug 25 07:08:41 devstack sudo[113354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:41 devstack sudo[113354]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info" returned: 0 in 0.232s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:41 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info is being set with open permissions: ugo+rw Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:41 devstack sudo[113357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info Aug 25 07:08:41 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:41 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.info" returned: 0 in 0.231s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.763s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3cb9613e-09f1-4940-ad08-566a453c817b tempest-CinderUnicodeTest-1535008211 None] Create snapshot completed successfully Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-e5b98cf7-c433-43bb-94e8-f9b24e8a36b8-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-e5b98cf7-c433-43bb-94e8-f9b24e8a36b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-quobyte-c9130117-b065-4909-8830-b67280dfb1a5" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-c9130117-b065-4909-8830-b67280dfb1a5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:41 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-quobyte-e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Deleting offline snapshot e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 of volume c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] snapshot_file for this snap is: volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab87572-292a-45cf-9c32-1d77cbd496d6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:42 devstack sudo[113360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 Aug 25 07:08:42 devstack sudo[113360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:42 devstack sudo[113360]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" returned: 0 in 0.344s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9130117-b065-4909-8830-b67280dfb1a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1537246d-5500-41fe-a3ce-e3c2617117bb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:42 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 Aug 25 07:08:42 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:42 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5" returned: 0 in 0.340s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:42 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 Aug 25 07:08:42 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:43 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" returned: 0 in 0.314s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:43 devstack sudo[113375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8 Aug 25 07:08:43 devstack sudo[113375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:43 devstack sudo[113375]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5.e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" returned: 0 in 0.233s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-e5b98cf7-c433-43bb-94e8-f9b24e8a36b8" released by "_delete_snapshot" :: held 1.325s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-c9130117-b065-4909-8830-b67280dfb1a5" released by "delete_snapshot" :: held 1.344s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Created reservations ['5483e9f7-21aa-4822-85b5-21cff2c7c388', '128d6c9f-da17-4f54-827f-f8d0dbb85fc5', '73298856-3be0-4cfb-9849-7491de197693', '556c5885-c870-4250-826f-654d32c4322e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Delete snapshot completed successfully. Aug 25 07:08:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8c9c5205-7627-4c72-9327-20a2b87e09c7 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-e5b98cf7-c433-43bb-94e8-f9b24e8a36b8-delete_snapshot" released by "delete_snapshot" :: held 1.465s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-c9130117-b065-4909-8830-b67280dfb1a5-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-c9130117-b065-4909-8830-b67280dfb1a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-quobyte-c9130117-b065-4909-8830-b67280dfb1a5" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-c9130117-b065-4909-8830-b67280dfb1a5" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d2640-ffe2-40b5-8d13-dfec8c5c73bd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:44 devstack sudo[113378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 Aug 25 07:08:44 devstack sudo[113378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:44 devstack sudo[113378]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:44 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5 Aug 25 07:08:44 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:44 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9130117-b065-4909-8830-b67280dfb1a5" returned: 0 in 0.230s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-c9130117-b065-4909-8830-b67280dfb1a5" released by "delete_volume" :: held 0.632s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Created reservations ['04347a23-dcc3-4f16-b269-623641ad2838', 'd01b2def-a7fe-4eda-9736-c97a47c5bc02', 'fd2ef16a-ecb9-4bb2-89a1-8ee37ca599e3', 'bac03855-fb75-4b96-927b-dfbb651508f8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:44 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:44 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:45 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.234s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:45 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Deleted volume successfully. Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-08ddbab0-9ed5-4ed5-9796-a708fa8fbec9 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-c9130117-b065-4909-8830-b67280dfb1a5-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-d42f9ad8-a208-4c17-9629-eb1636fb6b1d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-d42f9ad8-a208-4c17-9629-eb1636fb6b1d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "cinder-quobyte-d42f9ad8-a208-4c17-9629-eb1636fb6b1d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-d42f9ad8-a208-4c17-9629-eb1636fb6b1d" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c375ac-4be2-4fae-ac32-68e3b5bfdd3d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:45 devstack sudo[113389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d Aug 25 07:08:45 devstack sudo[113389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:45 devstack sudo[113389]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d" returned: 0 in 0.351s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:45 devstack sudo[113394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d Aug 25 07:08:45 devstack sudo[113394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:45 devstack sudo[113394]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d42f9ad8-a208-4c17-9629-eb1636fb6b1d" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-quobyte-d42f9ad8-a208-4c17-9629-eb1636fb6b1d" released by "delete_volume" :: held 0.620s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:45 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Created reservations ['43595fb8-4d2e-4c51-9cfa-2da124eaf1bc', '73672a05-8db8-4fb8-b589-17a949cdd150', '1c8729ad-fc36-4d5d-b3db-74d1f0ae8e1a', '2bb04b8c-2447-4921-920d-35d6ec9e8318'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:08:46 devstack sudo[113397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:08:46 devstack sudo[113397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:08:46 devstack sudo[113397]: pam_unix(sudo:session): session closed for user root Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.230s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:08:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Deleted volume successfully. Aug 25 07:08:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f018f706-09c5-4ac1-b475-94202766b9c2 tempest-CinderUnicodeTest-1535008211 None] Lock "cinder-d42f9ad8-a208-4c17-9629-eb1636fb6b1d-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:08:56 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=94,cinder:UPDATE=113,cinder:INSERT=28,cinder:DELETE=7 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:08:56 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=113,cinder:SELECT=71,cinder:INSERT=27,cinder:DELETE=13 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Flow 'volume_create_manager' (1aa50b51-5d5a-48fd-9f11-2300b8b53a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adba7bb4-4e4e-4406-a2d2-48abb46b34a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adba7bb4-4e4e-4406-a2d2-48abb46b34a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2012181948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16162c8-f90c-47f2-8ddc-09be0994279f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bf6cbc951a4c0a99ac9b5171814f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:11Z,use_quota=True,user_id='8425076a43dc43879211c98fd2a6ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e55dda7-03c3-480e-b4aa-472319c844c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e55dda7-03c3-480e-b4aa-472319c844c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be498f64-832d-460d-9b0b-ff422a5d3501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be498f64-832d-460d-9b0b-ff422a5d3501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16162c8-f90c-47f2-8ddc-09be0994279f', 'volume_name': 'volume-d16162c8-f90c-47f2-8ddc-09be0994279f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8461ddb-d4e2-4a02-bc80-163a7fda5de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8461ddb-d4e2-4a02-bc80-163a7fda5de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595e2059-e259-49e8-9e6a-b03d524b265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:10 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Volume d16162c8-f90c-47f2-8ddc-09be0994279f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16162c8-f90c-47f2-8ddc-09be0994279f', 'volume_size': 1} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2012181948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16162c8-f90c-47f2-8ddc-09be0994279f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bf6cbc951a4c0a99ac9b5171814f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:11Z,use_quota=True,user_id='8425076a43dc43879211c98fd2a6ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Creating volume d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:10 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:10 devstack sudo[113407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f 1073741824 Aug 25 07:09:10 devstack sudo[113407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:11 devstack sudo[113407]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f 1073741824" returned: 0 in 0.397s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:11 devstack sudo[113412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f Aug 25 07:09:11 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:11 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f" returned: 0 in 0.238s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595e2059-e259-49e8-9e6a-b03d524b265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16162c8-f90c-47f2-8ddc-09be0994279f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1053905f-64a4-456e-8d9e-3feea68bef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Volume volume-d16162c8-f90c-47f2-8ddc-09be0994279f (d16162c8-f90c-47f2-8ddc-09be0994279f): created successfully Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1053905f-64a4-456e-8d9e-3feea68bef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Flow 'volume_create_manager' (1aa50b51-5d5a-48fd-9f11-2300b8b53a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e9cdc2b8-020e-4dc0-93f2-3f38b7e272f4 tempest-SnapshotDependencyTests-933802077 None] Created volume successfully. Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Creating offline snapshot 0d4b41f0-e592-47c5-b852-16d8a723ca19 of volume d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[189de988-4050-4030-bfdd-ee21adcbb606]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:12 devstack sudo[113415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f Aug 25 07:09:12 devstack sudo[113415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:12 devstack sudo[113415]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f" returned: 0 in 0.333s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:12 devstack sudo[113421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 1G Aug 25 07:09:12 devstack sudo[113421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:12 devstack sudo[113421]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 1G" returned: 0 in 0.375s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16162c8-f90c-47f2-8ddc-09be0994279f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:12 devstack sudo[113426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16162c8-f90c-47f2-8ddc-09be0994279f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 Aug 25 07:09:12 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:12 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16162c8-f90c-47f2-8ddc-09be0994279f -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19" returned: 0 in 0.294s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:12 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 is being set with open permissions: ugo+rw Aug 25 07:09:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:12 devstack sudo[113431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 Aug 25 07:09:12 devstack sudo[113431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:13 devstack sudo[113431]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19" returned: 0 in 0.232s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:13 devstack sudo[113434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info Aug 25 07:09:13 devstack sudo[113434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:13 devstack sudo[113434]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info" returned: 0 in 0.235s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:13 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info is being set with open permissions: ugo+rw Aug 25 07:09:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:13 devstack sudo[113437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info Aug 25 07:09:13 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:13 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.info" returned: 0 in 0.227s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.783s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:13 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7a832b91-de77-4e15-8782-1595b2310b9e tempest-SnapshotDependencyTests-933802077 None] Create snapshot completed successfully Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Flow 'volume_create_manager' (f34fe6cd-8360-4a91-8ff8-70d58a996394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdc6ad4-ed51-47f6-a5c2-5958eac2b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdc6ad4-ed51-47f6-a5c2-5958eac2b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24dccfd-4316-4f7a-8ef3-6dd5c56aed57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bf6cbc951a4c0a99ac9b5171814f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d4b41f0-e592-47c5-b852-16d8a723ca19,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:14Z,use_quota=True,user_id='8425076a43dc43879211c98fd2a6ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f24b72-7888-4168-9187-a03b11d3ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f24b72-7888-4168-9187-a03b11d3ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf000b92-32a7-49b1-863e-4e442d0775c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf000b92-32a7-49b1-863e-4e442d0775c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c24dccfd-4316-4f7a-8ef3-6dd5c56aed57', 'volume_name': 'volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57', 'volume_size': 1, 'snapshot_id': '0d4b41f0-e592-47c5-b852-16d8a723ca19'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cd2017-9f41-4c79-9ddf-318b6b46190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cd2017-9f41-4c79-9ddf-318b6b46190e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcee4ac-fdc7-4fb5-b829-f6bcf50f1302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Volume c24dccfd-4316-4f7a-8ef3-6dd5c56aed57: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57', 'volume_size': 1, 'snapshot_id': '0d4b41f0-e592-47c5-b852-16d8a723ca19'} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-quobyte-0d4b41f0-e592-47c5-b852-16d8a723ca19-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-0d4b41f0-e592-47c5-b852-16d8a723ca19-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Creating volume c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 from snapshot 0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-quobyte-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] snapshot: 0d4b41f0-e592-47c5-b852-16d8a723ca19, volume: c24dccfd-4316-4f7a-8ef3-6dd5c56aed57, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee7340-6f12-4c33-94cd-f01056ed1505]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:14 devstack sudo[113440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 Aug 25 07:09:14 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:15 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16162c8-f90c-47f2-8ddc-09be0994279f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed9e7c-1237-4ef4-8d56-5c749ac51b3c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:15 devstack sudo[113445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f Aug 25 07:09:15 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:15 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:09:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:15 devstack sudo[113450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 Aug 25 07:09:15 devstack sudo[113450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[113450]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" returned: 0 in 4.045s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:09:19 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Converted 1024.00 MB image at 253.07 MB/s Aug 25 07:09:19 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 is being set with open permissions: ugo+rw Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:19 devstack sudo[113464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 Aug 25 07:09:19 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:19 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" returned: 0 in 0.236s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" released by "_copy_volume_from_snapshot" :: held 5.027s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-0d4b41f0-e592-47c5-b852-16d8a723ca19-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" released by "_create_volume_from_snapshot" :: held 5.099s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.112s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcee4ac-fdc7-4fb5-b829-f6bcf50f1302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57', 'volume_size': 1, 'snapshot_id': '0d4b41f0-e592-47c5-b852-16d8a723ca19'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc5b7b7-51dd-42ab-9f5e-bd401b3f15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Volume volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 (c24dccfd-4316-4f7a-8ef3-6dd5c56aed57): created successfully Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc5b7b7-51dd-42ab-9f5e-bd401b3f15f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Flow 'volume_create_manager' (f34fe6cd-8360-4a91-8ff8-70d58a996394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-286e5c41-4ba0-4fe9-9e21-2b7dff3102ff tempest-SnapshotDependencyTests-933802077 None] Created volume successfully. Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-0d4b41f0-e592-47c5-b852-16d8a723ca19-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-0d4b41f0-e592-47c5-b852-16d8a723ca19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-quobyte-d16162c8-f90c-47f2-8ddc-09be0994279f" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-d16162c8-f90c-47f2-8ddc-09be0994279f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-quobyte-0d4b41f0-e592-47c5-b852-16d8a723ca19" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-0d4b41f0-e592-47c5-b852-16d8a723ca19" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Deleting offline snapshot 0d4b41f0-e592-47c5-b852-16d8a723ca19 of volume d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] snapshot_file for this snap is: volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f861bd-e091-4b22-8845-fe72fc2a293d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:20 devstack sudo[113468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 Aug 25 07:09:20 devstack sudo[113468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:20 devstack sudo[113468]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19" returned: 0 in 0.403s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16162c8-f90c-47f2-8ddc-09be0994279f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5790563-ffb6-457e-adaf-d071fac51ff4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:20 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f Aug 25 07:09:20 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f" returned: 0 in 0.570s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack sudo[113478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 Aug 25 07:09:21 devstack sudo[113478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack sudo[113478]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19" returned: 0 in 0.381s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:21 devstack sudo[113483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19 Aug 25 07:09:21 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:21 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f.0d4b41f0-e592-47c5-b852-16d8a723ca19" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-0d4b41f0-e592-47c5-b852-16d8a723ca19" released by "_delete_snapshot" :: held 1.732s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-d16162c8-f90c-47f2-8ddc-09be0994279f" released by "delete_snapshot" :: held 1.760s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Created reservations ['32b00c57-0990-4d01-be74-460e4bde9128', '12b1c36e-7b3c-4a1a-ba4f-4aafbf366701', '4229c92c-02ea-4bba-8c3c-aff8fb258238', 'dc22c56b-92f2-4570-8ead-befe8a9cdd01'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Delete snapshot completed successfully. Aug 25 07:09:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87517ca2-14e3-4a8e-ab76-cc2722074555 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-0d4b41f0-e592-47c5-b852-16d8a723ca19-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-d16162c8-f90c-47f2-8ddc-09be0994279f-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-d16162c8-f90c-47f2-8ddc-09be0994279f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-quobyte-d16162c8-f90c-47f2-8ddc-09be0994279f" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-d16162c8-f90c-47f2-8ddc-09be0994279f" acquired by "delete_volume" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e27285-5120-41ac-a1d3-df450d8e6377]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:22 devstack sudo[113486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f Aug 25 07:09:22 devstack sudo[113486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:22 devstack sudo[113486]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:22 devstack sudo[113526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f Aug 25 07:09:22 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:23 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d16162c8-f90c-47f2-8ddc-09be0994279f" returned: 0 in 0.294s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-d16162c8-f90c-47f2-8ddc-09be0994279f" released by "delete_volume" :: held 0.747s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Created reservations ['bfe7b199-79cf-4f77-b98e-c71ca90a0d20', 'dc125c0d-38f4-46d1-8c0b-b82e797bab73', 'ec5713c5-cddd-41ef-ba81-8125e4c14140', 'b23865fb-b751-4b57-ab69-b01dc1749123'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:23 devstack sudo[113531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:09:23 devstack sudo[113531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:23 devstack sudo[113531]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Deleted volume successfully. Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a9694586-2385-4e0b-ba40-ec264ef3cc53 tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-d16162c8-f90c-47f2-8ddc-09be0994279f-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "cinder-quobyte-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731ef99-2f13-4b60-9590-768658cf95e6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:23 devstack sudo[113534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 Aug 25 07:09:23 devstack sudo[113534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:23 devstack sudo[113534]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" returned: 0 in 0.412s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:24 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57 Aug 25 07:09:24 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:24 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" returned: 0 in 0.253s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-quobyte-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57" released by "delete_volume" :: held 0.706s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Created reservations ['c56c01fd-2cc5-4975-b1b3-bfb3514a14a9', '86dca6ff-00fa-495f-8d3d-76fdc5031ced', '2981dcb0-58bf-4628-876b-4e667c534fbd', '732382b5-40df-46a3-8f88-2d276e647ed7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:24 devstack sudo[113542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:09:24 devstack sudo[113542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:24 devstack sudo[113542]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.256s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Deleted volume successfully. Aug 25 07:09:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f66393d1-48fc-4b34-b5cc-9bcc6ed1bece tempest-SnapshotDependencyTests-933802077 None] Lock "cinder-c24dccfd-4316-4f7a-8ef3-6dd5c56aed57-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:31 devstack sudo[113549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:09:31 devstack sudo[113549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:32 devstack sudo[113549]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:09:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:09:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:09:34 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=31 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:09:34 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:DELETE=5,cinder:INSERT=6 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Flow 'volume_create_manager' (38239a60-20e7-4f24-8022-3caf3c995b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28534eca-6b5c-4efb-bb7d-7d02ac0d8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28534eca-6b5c-4efb-bb7d-7d02ac0d8836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1006807870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11742b2f-3525-4851-b42a-24510f4e7153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e5f114bfb4f818df008d21df193fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:45Z,use_quota=True,user_id='48e77306063844caaf5909582194b054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522cc1ed-ba53-40bb-ba6b-4b136a53e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522cc1ed-ba53-40bb-ba6b-4b136a53e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acec1e01-b4a9-4030-9433-a4074ae6bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acec1e01-b4a9-4030-9433-a4074ae6bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11742b2f-3525-4851-b42a-24510f4e7153', 'volume_name': 'volume-11742b2f-3525-4851-b42a-24510f4e7153', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7415de-f99d-4da2-a811-45858117af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7415de-f99d-4da2-a811-45858117af63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404faa31-40e0-4a47-b4b1-65bfd678043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Volume 11742b2f-3525-4851-b42a-24510f4e7153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11742b2f-3525-4851-b42a-24510f4e7153', 'volume_size': 1} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1006807870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11742b2f-3525-4851-b42a-24510f4e7153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e5f114bfb4f818df008d21df193fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:45Z,use_quota=True,user_id='48e77306063844caaf5909582194b054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Creating volume 11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:45 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:45 devstack sudo[113596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 1073741824 Aug 25 07:09:45 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (8acef7e7-1f73-4118-b1c4-09849b762454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efbc3cf-9b4b-44e6-9a68-7b2cb8f3a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efbc3cf-9b4b-44e6-9a68-7b2cb8f3a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729785432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434e5674-2383-4bca-9c92-1d0278d00bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:46Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a73a712-501a-4307-818a-c03635ebe0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a73a712-501a-4307-818a-c03635ebe0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d795c6-2e95-4c54-85be-ce8ce78861dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d795c6-2e95-4c54-85be-ce8ce78861dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '434e5674-2383-4bca-9c92-1d0278d00bf1', 'volume_name': 'volume-434e5674-2383-4bca-9c92-1d0278d00bf1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1cd6b9-85b9-486e-9dba-67a1355b7a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1cd6b9-85b9-486e-9dba-67a1355b7a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426e6f7f-ed3c-4ae6-8d00-77c0a8ef28d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:45 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume 434e5674-2383-4bca-9c92-1d0278d00bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-434e5674-2383-4bca-9c92-1d0278d00bf1', 'volume_size': 1} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:45 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 1073741824" returned: 0 in 0.611s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-48a6cc8e-8bc3-49c7-871a-ebb39b07d84d tempest-ProjectAdminTests-1985842190 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9913711547852, 'free_capacity_gb': 1774.9913711547852, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94460) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4852}} Aug 25 07:09:45 devstack sudo[113602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 Aug 25 07:09:45 devstack sudo[113602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:46 devstack sudo[113602]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153" returned: 0 in 0.289s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729785432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434e5674-2383-4bca-9c92-1d0278d00bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:46Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Creating volume 434e5674-2383-4bca-9c92-1d0278d00bf1 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:46 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404faa31-40e0-4a47-b4b1-65bfd678043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11742b2f-3525-4851-b42a-24510f4e7153', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d7ef3e-4af1-44a0-b2cb-8308a9f205e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:46 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 1073741824 Aug 25 07:09:46 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:46 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Volume volume-11742b2f-3525-4851-b42a-24510f4e7153 (11742b2f-3525-4851-b42a-24510f4e7153): created successfully Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d7ef3e-4af1-44a0-b2cb-8308a9f205e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Flow 'volume_create_manager' (38239a60-20e7-4f24-8022-3caf3c995b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:46 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f82da7c7-8920-41bd-919f-c3b3a92602ea tempest-VolumeDependencyTests-43059486 None] Created volume successfully. Aug 25 07:09:46 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 1073741824" returned: 0 in 0.549s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:46 devstack sudo[113610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 Aug 25 07:09:46 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:47 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426e6f7f-ed3c-4ae6-8d00-77c0a8ef28d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-434e5674-2383-4bca-9c92-1d0278d00bf1', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f70ecf2-32ed-458b-a84b-047bec5c94f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:47 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume volume-434e5674-2383-4bca-9c92-1d0278d00bf1 (434e5674-2383-4bca-9c92-1d0278d00bf1): created successfully Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f70ecf2-32ed-458b-a84b-047bec5c94f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (8acef7e7-1f73-4118-b1c4-09849b762454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-aa45cb6e-cefa-43e9-9d09-a464e437fef5 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created volume successfully. Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Creating offline snapshot d90bd750-2b1c-41ac-b5dc-8f79331f9a11 of volume 11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fba442c-39e4-489e-a69c-cf0a7d671ec3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:47 devstack sudo[113614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 Aug 25 07:09:47 devstack sudo[113614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack sudo[113614]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[113619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 1G Aug 25 07:09:48 devstack sudo[113619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (f9525483-5997-4f12-80a4-30405fb8e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f06c67-9626-4d94-8727-824217083f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f06c67-9626-4d94-8727-824217083f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1460289440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63773d4c-77a3-4f07-9f53-24e38234524d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:48Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75dc5d6-08d2-4679-8a9d-a8014f970d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75dc5d6-08d2-4679-8a9d-a8014f970d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b229a99f-b647-46af-bc43-4feab91ed15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b229a99f-b647-46af-bc43-4feab91ed15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63773d4c-77a3-4f07-9f53-24e38234524d', 'volume_name': 'volume-63773d4c-77a3-4f07-9f53-24e38234524d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbb8410-ff9d-4c1c-a5cc-72f71f1f5e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbb8410-ff9d-4c1c-a5cc-72f71f1f5e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01eb8fb-2b51-4bcb-84d4-85481d078fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:48 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume 63773d4c-77a3-4f07-9f53-24e38234524d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63773d4c-77a3-4f07-9f53-24e38234524d', 'volume_size': 1} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:48 devstack sudo[113619]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 1G" returned: 0 in 0.724s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11742b2f-3525-4851-b42a-24510f4e7153 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:48 devstack sudo[113625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11742b2f-3525-4851-b42a-24510f4e7153 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 Aug 25 07:09:48 devstack sudo[113625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (fc95f929-5329-4c30-9ac5-55f3dd95b620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e70ec1a-e0d6-4971-b7fe-09ede7070c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e70ec1a-e0d6-4971-b7fe-09ede7070c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1319531453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a72564-081d-4459-824d-d1b0657f8f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:49Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462607f6-adf7-4d69-8956-f6c863bf07fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462607f6-adf7-4d69-8956-f6c863bf07fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b48927-45f3-4806-b1ea-db46ed05952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b48927-45f3-4806-b1ea-db46ed05952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a72564-081d-4459-824d-d1b0657f8f75', 'volume_name': 'volume-76a72564-081d-4459-824d-d1b0657f8f75', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd6f412-97e0-4aa0-b1c0-f3870a15bf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd6f412-97e0-4aa0-b1c0-f3870a15bf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c981c2f-2119-446d-80f6-e6f5145e9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume 76a72564-081d-4459-824d-d1b0657f8f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a72564-081d-4459-824d-d1b0657f8f75', 'volume_size': 1} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:49 devstack sudo[113625]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11742b2f-3525-4851-b42a-24510f4e7153 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11" returned: 0 in 0.542s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:49 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 is being set with open permissions: ugo+rw Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:49 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 Aug 25 07:09:49 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (884c634d-c308-4094-96f0-37956ac184e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f890b607-e496-4d45-984f-3edf4726b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f890b607-e496-4d45-984f-3edf4726b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171147214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:50Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfacbc8-cb1b-4086-9d5e-af26e73cf4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfacbc8-cb1b-4086-9d5e-af26e73cf4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c2c4a-77bf-41fc-b1dc-559570cca1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c2c4a-77bf-41fc-b1dc-559570cca1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051', 'volume_name': 'volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ed6201-311b-4dde-b5f2-eac58bf58157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ed6201-311b-4dde-b5f2-eac58bf58157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dacc6b-91f5-414b-8da1-9d66502d733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051', 'volume_size': 1} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:49 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11" returned: 0 in 0.535s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:49 devstack sudo[113634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info Aug 25 07:09:49 devstack sudo[113634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (2b778fa6-ad15-4e46-b160-ecf7fc2d01b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce7f1af-5716-49ed-b9cd-5d2f984393a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce7f1af-5716-49ed-b9cd-5d2f984393a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636172201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6441bde-7915-4298-ad30-d41ffe24394f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:50Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e3ff6a-7922-49c7-b521-daeada1dd68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e3ff6a-7922-49c7-b521-daeada1dd68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e395746-8dd5-4c46-ab55-cb245aae7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e395746-8dd5-4c46-ab55-cb245aae7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6441bde-7915-4298-ad30-d41ffe24394f', 'volume_name': 'volume-a6441bde-7915-4298-ad30-d41ffe24394f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ddd19d-4de5-4223-badc-1742efae9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ddd19d-4de5-4223-badc-1742efae9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833dd1c5-d2b0-45ef-b4e2-8f4190a41520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume a6441bde-7915-4298-ad30-d41ffe24394f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6441bde-7915-4298-ad30-d41ffe24394f', 'volume_size': 1} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:50 devstack sudo[113634]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info" returned: 0 in 0.392s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:50 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info is being set with open permissions: ugo+rw Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:50 devstack sudo[113637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info Aug 25 07:09:50 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:50 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.info" returned: 0 in 0.295s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1460289440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63773d4c-77a3-4f07-9f53-24e38234524d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:48Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Creating volume 63773d4c-77a3-4f07-9f53-24e38234524d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:50 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:50 devstack sudo[113640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d 1073741824 Aug 25 07:09:50 devstack sudo[113640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Flow 'volume_create_manager' (f62f57af-096c-4dd8-aa9c-c9981775b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2358647d-606d-4aaf-b9ec-c11baf4f643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-69077ca1-af4b-44d4-b9c9-dfb9d0d35b10 tempest-VolumeDependencyTests-43059486 None] Create snapshot completed successfully Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2358647d-606d-4aaf-b9ec-c11baf4f643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5a54085e224b068aa5ace9ad2f41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:51Z,use_quota=True,user_id='6de9fe9c28b842c39015d07c75c599f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a69572f0-5ae5-4aba-9c27-374b1db84f4c),volume_type_id=a69572f0-5ae5-4aba-9c27-374b1db84f4c)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371db719-1243-4cf0-8b4f-f8b13c4aacb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371db719-1243-4cf0-8b4f-f8b13c4aacb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af420a25-5701-4798-9d5c-6dd80cd6f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (ebc73697-0a52-44f7-b932-8c558a25eaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729f2621-0931-4438-b0f4-f1f66b46ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729f2621-0931-4438-b0f4-f1f66b46ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-950620144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57e5a2c-a4a6-4677-9d77-602ad2799d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:51Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082ed3e8-b5a3-464f-b971-4040d1c659bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082ed3e8-b5a3-464f-b971-4040d1c659bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5203fd65-0f9a-4290-9e5e-7e2a1dc222df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5203fd65-0f9a-4290-9e5e-7e2a1dc222df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57e5a2c-a4a6-4677-9d77-602ad2799d7c', 'volume_name': 'volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54489e9-bfd7-4d65-ae55-06859a69c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54489e9-bfd7-4d65-ae55-06859a69c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe70d6c-c4f4-4ef3-86d0-9f578889b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume f57e5a2c-a4a6-4677-9d77-602ad2799d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c', 'volume_size': 1} Aug 25 07:09:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:51 devstack sudo[113640]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d 1073741824" returned: 0 in 0.596s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af420a25-5701-4798-9d5c-6dd80cd6f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9', 'volume_name': 'volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9', 'volume_size': 1, 'image_id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4681ecc7ed852bbfd96ca5eaacfaa347', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f5a54085e224b068aa5ace9ad2f41a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9172c39192f14b0d5d673aeefbead047bee54f0fb0a7019b91fdb3600447a11484373e07c8e5eff628e4e668db9945e0f4518725138ae8eb1e7f45ef3dd808f3', 'id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'created_at': datetime.datetime(2026, 8, 25, 5, 9, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 9, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03531b3f-7ae8-4017-946d-5828dd14984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03531b3f-7ae8-4017-946d-5828dd14984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b00847-b950-4637-9b3e-09e5f1707265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Volume 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9', 'volume_size': 1, 'image_id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4681ecc7ed852bbfd96ca5eaacfaa347', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f5a54085e224b068aa5ace9ad2f41a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9172c39192f14b0d5d673aeefbead047bee54f0fb0a7019b91fdb3600447a11484373e07c8e5eff628e4e668db9945e0f4518725138ae8eb1e7f45ef3dd808f3', 'id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'created_at': datetime.datetime(2026, 8, 25, 5, 9, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 9, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Trying to clone 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 from image daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:51 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d Aug 25 07:09:51 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:09:51 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29822f-2f9b-476e-90f3-cf1f8a0d353b]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:51 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Flow 'volume_create_manager' (fca9df8c-13dd-41e1-a8b3-89a2251032db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfaf07-b5fd-448d-942c-f9b1ac282d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d" returned: 0 in 0.363s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.409s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1319531453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a72564-081d-4459-824d-d1b0657f8f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:49Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Creating volume 76a72564-081d-4459-824d-d1b0657f8f75 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:51 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:51 devstack sudo[113648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD Aug 25 07:09:51 devstack sudo[113648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfaf07-b5fd-448d-942c-f9b1ac282d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-948565852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca878834-a6eb-400d-81f3-2efa6e115fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52e5f114bfb4f818df008d21df193fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d90bd750-2b1c-41ac-b5dc-8f79331f9a11,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:52Z,use_quota=True,user_id='48e77306063844caaf5909582194b054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61dbb47-70e8-4d39-9cd9-f74ab0a90ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61dbb47-70e8-4d39-9cd9-f74ab0a90ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 1073741824 Aug 25 07:09:51 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1d395e-6fe7-4110-8399-f90177cc7a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1d395e-6fe7-4110-8399-f90177cc7a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca878834-a6eb-400d-81f3-2efa6e115fa2', 'volume_name': 'volume-ca878834-a6eb-400d-81f3-2efa6e115fa2', 'volume_size': 1, 'snapshot_id': 'd90bd750-2b1c-41ac-b5dc-8f79331f9a11'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59498915-a23e-4650-9494-df3b0c8776a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59498915-a23e-4650-9494-df3b0c8776a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538cdd60-c2fa-49bf-b991-630814b3d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Volume ca878834-a6eb-400d-81f3-2efa6e115fa2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca878834-a6eb-400d-81f3-2efa6e115fa2', 'volume_size': 1, 'snapshot_id': 'd90bd750-2b1c-41ac-b5dc-8f79331f9a11'} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01eb8fb-2b51-4bcb-84d4-85481d078fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63773d4c-77a3-4f07-9f53-24e38234524d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34e2d7a-001a-472d-a955-752091fb7c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume volume-63773d4c-77a3-4f07-9f53-24e38234524d (63773d4c-77a3-4f07-9f53-24e38234524d): created successfully Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34e2d7a-001a-472d-a955-752091fb7c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (f9525483-5997-4f12-80a4-30405fb8e83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f0606142-fcaf-4292-95a3-dbda34bf4b78 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created volume successfully. Aug 25 07:09:52 devstack sudo[113648]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:52 devstack sudo[113657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD Aug 25 07:09:52 devstack sudo[113657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:52 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 1073741824" returned: 0 in 0.566s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:52 devstack sudo[113663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 Aug 25 07:09:52 devstack sudo[113663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:52 devstack sudo[113657]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Temporary image daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 is fetched for user 6de9fe9c28b842c39015d07c75c599f3. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d064c-8702-439c-a060-fb33ce45b2ba]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:52 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD Aug 25 07:09:52 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:52 devstack sudo[113663]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.896s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171147214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:50Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Creating volume f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:52 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:52 devstack sudo[113671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 1073741824 Aug 25 07:09:52 devstack sudo[113671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c981c2f-2119-446d-80f6-e6f5145e9190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a72564-081d-4459-824d-d1b0657f8f75', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0648bf1b-1b2b-47d2-8ccb-805bdcd9cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:52 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume volume-76a72564-081d-4459-824d-d1b0657f8f75 (76a72564-081d-4459-824d-d1b0657f8f75): created successfully Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0648bf1b-1b2b-47d2-8ccb-805bdcd9cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (fc95f929-5329-4c30-9ac5-55f3dd95b620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:52 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fdde4adb-4aac-4eb1-a814-4edfb6ac8c29 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created volume successfully. Aug 25 07:09:52 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:53 devstack sudo[113675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD Aug 25 07:09:53 devstack sudo[113675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:53 devstack sudo[113671]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 1073741824" returned: 0 in 0.568s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:53 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 Aug 25 07:09:53 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:53 devstack sudo[113675]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:53 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.422s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636172201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6441bde-7915-4298-ad30-d41ffe24394f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:50Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Creating volume a6441bde-7915-4298-ad30-d41ffe24394f {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:53 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dacc6b-91f5-414b-8da1-9d66502d733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:53 devstack sudo[113687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f 1073741824 Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006cbc9a-7a91-4d81-899b-e658fdd42636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:53 devstack sudo[113687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 (f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051): created successfully Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006cbc9a-7a91-4d81-899b-e658fdd42636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (884c634d-c308-4094-96f0-37956ac184e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-08e042cb-490a-4fe0-a047-a025bc32da48 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created volume successfully. Aug 25 07:09:54 devstack sudo[113687]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f 1073741824" returned: 0 in 0.498s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:54 devstack sudo[113693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f Aug 25 07:09:54 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:54 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f" returned: 0 in 0.264s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.428s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-950620144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57e5a2c-a4a6-4677-9d77-602ad2799d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5dedaeded4cfe864cabc6d1d219d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:51Z,use_quota=True,user_id='aefe4d2c38774cd78a2574a73b69f2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Creating volume f57e5a2c-a4a6-4677-9d77-602ad2799d7c {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:54 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833dd1c5-d2b0-45ef-b4e2-8f4190a41520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6441bde-7915-4298-ad30-d41ffe24394f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack sudo[113696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c 1073741824 Aug 25 07:09:54 devstack sudo[113696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b57a4c-10a7-4e94-8fca-54574d152e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:54 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume volume-a6441bde-7915-4298-ad30-d41ffe24394f (a6441bde-7915-4298-ad30-d41ffe24394f): created successfully Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b57a4c-10a7-4e94-8fca-54574d152e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (2b778fa6-ad15-4e46-b160-ecf7fc2d01b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7639ffd1-48a0-4cd7-a37c-eee45761350a tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created volume successfully. Aug 25 07:09:54 devstack sudo[113696]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c 1073741824" returned: 0 in 0.514s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:55 devstack sudo[113704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c Aug 25 07:09:55 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:55 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.459s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-quobyte-d90bd750-2b1c-41ac-b5dc-8f79331f9a11-ca878834-a6eb-400d-81f3-2efa6e115fa2" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe70d6c-c4f4-4ef3-86d0-9f578889b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d61ac4-fbd6-44d7-9672-05f83a002b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-d90bd750-2b1c-41ac-b5dc-8f79331f9a11-ca878834-a6eb-400d-81f3-2efa6e115fa2" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Creating volume ca878834-a6eb-400d-81f3-2efa6e115fa2 from snapshot d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-quobyte-ca878834-a6eb-400d-81f3-2efa6e115fa2" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Volume volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c (f57e5a2c-a4a6-4677-9d77-602ad2799d7c): created successfully Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d61ac4-fbd6-44d7-9672-05f83a002b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Flow 'volume_create_manager' (ebc73697-0a52-44f7-b932-8c558a25eaea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-ca878834-a6eb-400d-81f3-2efa6e115fa2" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] snapshot: d90bd750-2b1c-41ac-b5dc-8f79331f9a11, volume: ca878834-a6eb-400d-81f3-2efa6e115fa2, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:09:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-44d12e40-4518-41d3-b820-b131b3b705d3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created volume successfully. Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2db7b2-6ab0-427f-b839-90b309b9ef17]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:55 devstack sudo[113707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 Aug 25 07:09:55 devstack sudo[113707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:55 devstack sudo[113707]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11742b2f-3525-4851-b42a-24510f4e7153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d783a7fe-dff5-4712-b390-e6000aaeface]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:55 devstack sudo[113712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 Aug 25 07:09:55 devstack sudo[113712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-f57e5a2c-a4a6-4677-9d77-602ad2799d7c-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-f57e5a2c-a4a6-4677-9d77-602ad2799d7c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:56 devstack sudo[113712]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-quobyte-f57e5a2c-a4a6-4677-9d77-602ad2799d7c" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153" returned: 0 in 0.492s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack sudo[113718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 Aug 25 07:09:56 devstack sudo[113718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-f57e5a2c-a4a6-4677-9d77-602ad2799d7c" acquired by "delete_volume" :: waited 0.043s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Flow 'volume_create_manager' (9550cdc6-2728-469b-b9aa-8b9e0b0f8a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b022460-22f4-4073-944a-39cda195c80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[736dbe82-acb2-40f8-84b5-620baee7adc4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b022460-22f4-4073-944a-39cda195c80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037575801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92cc2981-04a0-4092-ab41-5b8b950d9492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85944d96957456fb2b29a11ec2f06f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:56Z,use_quota=True,user_id='8020db897286425a86d8befdc32a1a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ab1d48-2450-4c91-9a4b-6c98fd4916f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ab1d48-2450-4c91-9a4b-6c98fd4916f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc9b6dd-ece7-4850-a61a-89f59be0eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc9b6dd-ece7-4850-a61a-89f59be0eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92cc2981-04a0-4092-ab41-5b8b950d9492', 'volume_name': 'volume-92cc2981-04a0-4092-ab41-5b8b950d9492', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a843d7b2-94e3-4087-98b3-8e67e72422b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a843d7b2-94e3-4087-98b3-8e67e72422b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bbf922-a215-4887-bb16-f463c49b4e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:09:56 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Volume 92cc2981-04a0-4092-ab41-5b8b950d9492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92cc2981-04a0-4092-ab41-5b8b950d9492', 'volume_size': 1} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:56 devstack sudo[113720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c Aug 25 07:09:56 devstack sudo[113720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:56 devstack sudo[113720]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c" returned: 0 in 0.420s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:56 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c Aug 25 07:09:56 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:57 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f57e5a2c-a4a6-4677-9d77-602ad2799d7c" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-f57e5a2c-a4a6-4677-9d77-602ad2799d7c" released by "delete_volume" :: held 0.908s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created reservations ['b2810de0-fb14-4a02-a435-d5e8c8ba8ce4', '49041e2c-0d07-4474-8d04-953ec9f55327', 'dbeb0cb9-93b7-468b-81a1-a047aa0dd068', '2d7c02a6-3b30-4076-97e8-e1f3624db7ab'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:57 devstack sudo[113738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:09:57 devstack sudo[113738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:57 devstack sudo[113738]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.416s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:09:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Deleted volume successfully. Aug 25 07:09:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd659d68-3b01-40aa-83be-206d401e4046 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-f57e5a2c-a4a6-4677-9d77-602ad2799d7c-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:09:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-a6441bde-7915-4298-ad30-d41ffe24394f-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-a6441bde-7915-4298-ad30-d41ffe24394f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-quobyte-a6441bde-7915-4298-ad30-d41ffe24394f" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:09:58 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-a6441bde-7915-4298-ad30-d41ffe24394f" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:09:58 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01e8508-711e-4b97-998f-33f255c989b8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:09:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:59 devstack sudo[113742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f Aug 25 07:09:59 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:09:59 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root Aug 25 07:09:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f" returned: 0 in 0.809s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:09:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:09:59 devstack sudo[113747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f Aug 25 07:09:59 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:00 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a6441bde-7915-4298-ad30-d41ffe24394f" returned: 0 in 0.506s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-a6441bde-7915-4298-ad30-d41ffe24394f" released by "delete_volume" :: held 1.401s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created reservations ['060a8f69-bf45-42af-b1d7-315bad731a76', '4a1a9bbc-de01-4446-ae56-688cd704f342', '30e5a035-ae36-4614-92e1-17f1d0ac91b5', '7303d24b-fc2b-4c9a-a427-9df5dcb7f68b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:00 devstack sudo[113751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:00 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-quobyte-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:01 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.756s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Deleted volume successfully. Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[badcbd59-e6d0-4d14-a997-4fafe06158ab]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d9a426d3-e64b-45cc-a928-7ab17e2524b3 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-a6441bde-7915-4298-ad30-d41ffe24394f-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:01 devstack sudo[113718]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2" returned: 0 in 5.078s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:10:01 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Converted 1024.00 MB image at 201.60 MB/s Aug 25 07:10:01 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 is being set with open permissions: ugo+rw Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:01 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 Aug 25 07:10:01 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 Aug 25 07:10:01 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-ca878834-a6eb-400d-81f3-2efa6e115fa2" released by "_copy_volume_from_snapshot" :: held 6.347s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:01 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051" returned: 0 in 0.410s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:01 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051 Aug 25 07:10:01 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-d90bd750-2b1c-41ac-b5dc-8f79331f9a11-ca878834-a6eb-400d-81f3-2efa6e115fa2" released by "_create_volume_from_snapshot" :: held 6.449s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.486s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.409s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5a54085e224b068aa5ace9ad2f41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:51Z,use_quota=True,user_id='6de9fe9c28b842c39015d07c75c599f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a69572f0-5ae5-4aba-9c27-374b1db84f4c),volume_type_id=a69572f0-5ae5-4aba-9c27-374b1db84f4c)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Creating volume 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:01 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538cdd60-c2fa-49bf-b991-630814b3d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca878834-a6eb-400d-81f3-2efa6e115fa2', 'volume_size': 1, 'snapshot_id': 'd90bd750-2b1c-41ac-b5dc-8f79331f9a11'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:01 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 1073741824 Aug 25 07:10:01 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78781d60-bbec-4b05-9edf-7af6cbc55bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:01 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Volume volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 (ca878834-a6eb-400d-81f3-2efa6e115fa2): created successfully Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78781d60-bbec-4b05-9edf-7af6cbc55bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Flow 'volume_create_manager' (fca9df8c-13dd-41e1-a8b3-89a2251032db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-98832021-399c-457a-8034-db219f9aeb0f tempest-VolumeDependencyTests-43059486 None] Created volume successfully. Aug 25 07:10:01 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051" released by "delete_volume" :: held 0.771s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created reservations ['bf84f947-176e-409b-a1dd-0958e7cc3091', 'b99785ab-67a7-41b0-bbca-a27edf2978c3', '3b24e83b-b90a-4905-be6d-4d35c6935e0e', 'b204b0bf-8690-4896-99dd-740ff5d7aafe'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack sudo[113771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:02 devstack sudo[113771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-76a72564-081d-4459-824d-d1b0657f8f75-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-76a72564-081d-4459-824d-d1b0657f8f75-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-quobyte-76a72564-081d-4459-824d-d1b0657f8f75" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-76a72564-081d-4459-824d-d1b0657f8f75" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:02 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 1073741824" returned: 0 in 0.586s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f39c8e-92c7-4068-8f75-5358eb8cb13f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 Aug 25 07:10:02 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:02 devstack sudo[113771]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Deleted volume successfully. Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f9596446-93f7-4aa4-8946-595fd5da0bc9 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-f1d1cbcd-ebd2-4cd8-ade2-3c5b009ac051-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:02 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 Aug 25 07:10:02 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-d90bd750-2b1c-41ac-b5dc-8f79331f9a11-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-d90bd750-2b1c-41ac-b5dc-8f79331f9a11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-quobyte-11742b2f-3525-4851-b42a-24510f4e7153" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-11742b2f-3525-4851-b42a-24510f4e7153" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-quobyte-d90bd750-2b1c-41ac-b5dc-8f79331f9a11" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-d90bd750-2b1c-41ac-b5dc-8f79331f9a11" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Deleting offline snapshot d90bd750-2b1c-41ac-b5dc-8f79331f9a11 of volume 11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] snapshot_file for this snap is: volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db89f3f-6d99-44d6-bc80-375de8a29294]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" returned: 0 in 0.317s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037575801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92cc2981-04a0-4092-ab41-5b8b950d9492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85944d96957456fb2b29a11ec2f06f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:09:56Z,use_quota=True,user_id='8020db897286425a86d8befdc32a1a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Creating volume 92cc2981-04a0-4092-ab41-5b8b950d9492 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:02 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack sudo[113781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 1073741824 Aug 25 07:10:02 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Attempting download of daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 ((None, [{'url': 'file:///opt/stack/data/glance/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'metadata': {}}])) to volume 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:10:02 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 Aug 25 07:10:02 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:02 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75" returned: 0 in 0.527s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[487df058-6931-4c2e-b89e-92746ff3a381]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:02 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75 Aug 25 07:10:02 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi Aug 25 07:10:03 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11" returned: 0 in 0.419s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11742b2f-3525-4851-b42a-24510f4e7153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7738ee-6167-448a-9421-ff99109d83c3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-76a72564-081d-4459-824d-d1b0657f8f75" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-76a72564-081d-4459-824d-d1b0657f8f75" released by "delete_volume" :: held 0.881s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created reservations ['7f5d667e-2bc1-4553-be75-aa0f574827d4', '41a4c3df-35ee-4002-b878-bc3cd56e8893', '96e083d3-9fc5-4f95-84c7-92ccd7756a64', '933b7604-1826-4a3f-aab9-dae0a9ce08a2'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:03 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 Aug 25 07:10:03 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 1073741824" returned: 0 in 0.578s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi" returned: 0 in 0.414s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 Aug 25 07:10:03 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-63773d4c-77a3-4f07-9f53-24e38234524d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:03 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:03 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-63773d4c-77a3-4f07-9f53-24e38234524d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:03 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi Aug 25 07:10:03 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-quobyte-63773d4c-77a3-4f07-9f53-24e38234524d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-63773d4c-77a3-4f07-9f53-24e38234524d" acquired by "delete_volume" :: waited 0.047s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51cc2bb-acde-4adc-a819-e37a523984e4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.392s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Deleted volume successfully. Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e95aa9f-0905-42f5-85f3-bb2e4ec9058b tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-76a72564-081d-4459-824d-d1b0657f8f75-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:03 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153" returned: 0 in 0.780s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:03 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492" returned: 0 in 0.522s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi" returned: 1 in 0.611s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_5bezptwi' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:03 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d Aug 25 07:10:03 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack sudo[113817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 Aug 25 07:10:03 devstack sudo[113817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fbe504-bdc5-4d89-89a8-f81f256f7100]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bbf922-a215-4887-bb16-f463c49b4e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92cc2981-04a0-4092-ab41-5b8b950d9492', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaf2f74-885c-45e8-a9a4-c39d0e4ebf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Volume volume-92cc2981-04a0-4092-ab41-5b8b950d9492 (92cc2981-04a0-4092-ab41-5b8b950d9492): created successfully Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaf2f74-885c-45e8-a9a4-c39d0e4ebf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Flow 'volume_create_manager' (9550cdc6-2728-469b-b9aa-8b9e0b0f8a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3c154761-3ea6-424f-9ae9-96d3353c104e tempest-ProjectReaderTests-964335684 None] Created volume successfully. Aug 25 07:10:04 devstack sudo[113820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD Aug 25 07:10:04 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:04 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d" returned: 0 in 0.565s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack sudo[113817]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11" returned: 0 in 0.385s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack sudo[113828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d Aug 25 07:10:04 devstack sudo[113828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:04 devstack sudo[113831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11 Aug 25 07:10:04 devstack sudo[113831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:04 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD Aug 25 07:10:04 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:04 devstack sudo[113828]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63773d4c-77a3-4f07-9f53-24e38234524d" returned: 0 in 0.302s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-63773d4c-77a3-4f07-9f53-24e38234524d" released by "delete_volume" :: held 0.953s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:04 devstack sudo[113831]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153.d90bd750-2b1c-41ac-b5dc-8f79331f9a11" returned: 0 in 0.314s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:04 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-d90bd750-2b1c-41ac-b5dc-8f79331f9a11" released by "_delete_snapshot" :: held 2.036s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 was raw, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-11742b2f-3525-4851-b42a-24510f4e7153" released by "delete_snapshot" :: held 2.087s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:04 devstack sudo[113841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 Aug 25 07:10:04 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created reservations ['ec0a66b9-852e-4f43-80a1-4bb63b68764f', '4264fe90-fee0-48f6-a648-8f06e68cac7e', '454a1867-2e02-4544-9988-ddda53494cb4', '00b15f90-1991-4d52-961f-413a0991bad7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Created reservations ['a8f6affa-e865-4296-a556-63720dad5247', 'f65cb270-a155-4d39-bf1f-baf130bd5460', '21876f8f-4f9c-476e-9861-ac9fea5ef5b5', 'edc62e7b-c650-4458-8ee5-3e3b64defe32'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:04 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:04 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Delete snapshot completed successfully. Aug 25 07:10:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-128e0c8c-2291-46e1-a502-46d84890a7c5 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-d90bd750-2b1c-41ac-b5dc-8f79331f9a11-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:05 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Deleted volume successfully. Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e2eba908-0987-4980-b773-1cddc3bef5de tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-63773d4c-77a3-4f07-9f53-24e38234524d-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:05 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" returned: 0 in 0.583s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6_70f9xjhidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:10:05 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Acquiring lock "cinder-92cc2981-04a0-4092-ab41-5b8b950d9492-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:05 devstack sudo[113849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 1G Aug 25 07:10:05 devstack sudo[113849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Lock "cinder-92cc2981-04a0-4092-ab41-5b8b950d9492-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Acquiring lock "cinder-quobyte-92cc2981-04a0-4092-ab41-5b8b950d9492" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Lock "cinder-quobyte-92cc2981-04a0-4092-ab41-5b8b950d9492" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[805e4c31-94d2-4755-b326-2b1b8bbbc683]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:05 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 Aug 25 07:10:05 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:05 devstack sudo[113849]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 1G" returned: 0 in 0.329s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Downloaded image daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 ((None, [{'url': 'file:///opt/stack/data/glance/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'metadata': {}}])) to volume 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Temporary image daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 for user 6de9fe9c28b842c39015d07c75c599f3 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Marking volume 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Copying metadata from image daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 to 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Creating volume glance metadata for volume 0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 backed by image daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4681ecc7ed852bbfd96ca5eaacfaa347', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b00847-b950-4637-9b3e-09e5f1707265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9', 'volume_size': 1, 'image_id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4681ecc7ed852bbfd96ca5eaacfaa347', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f5a54085e224b068aa5ace9ad2f41a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9172c39192f14b0d5d673aeefbead047bee54f0fb0a7019b91fdb3600447a11484373e07c8e5eff628e4e668db9945e0f4518725138ae8eb1e7f45ef3dd808f3', 'id': 'daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6', 'created_at': datetime.datetime(2026, 8, 25, 5, 9, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 9, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/daa561ff-e8b6-48ea-a6bd-7ad2b60f3ef6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833242ad-a3b4-431a-bdc1-a8c141524e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:05 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Volume volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 (0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9): created successfully Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833242ad-a3b4-431a-bdc1-a8c141524e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Flow 'volume_create_manager' (f62f57af-096c-4dd8-aa9c-c9981775b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-790de397-cde8-4eda-a554-bc4b9d619825 tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Created volume successfully. Aug 25 07:10:05 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492" returned: 0 in 0.430s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-434e5674-2383-4bca-9c92-1d0278d00bf1-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:05 devstack sudo[113859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492 Aug 25 07:10:05 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-434e5674-2383-4bca-9c92-1d0278d00bf1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-11742b2f-3525-4851-b42a-24510f4e7153-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-11742b2f-3525-4851-b42a-24510f4e7153-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "cinder-quobyte-434e5674-2383-4bca-9c92-1d0278d00bf1" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-quobyte-11742b2f-3525-4851-b42a-24510f4e7153" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-434e5674-2383-4bca-9c92-1d0278d00bf1" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-11742b2f-3525-4851-b42a-24510f4e7153" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d96cc7d-2056-4c33-98a6-3a9950fca5dd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3a0ad-4f0c-43b7-8513-b8b47a167456]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 Aug 25 07:10:06 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 Aug 25 07:10:06 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92cc2981-04a0-4092-ab41-5b8b950d9492" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Lock "cinder-quobyte-92cc2981-04a0-4092-ab41-5b8b950d9492" released by "delete_volume" :: held 0.813s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Created reservations ['fb305537-df8b-48fc-8641-4bcbfa51c460', 'a5aa658d-ebaf-4fb6-9101-f9a581d822b7', '65baf0ed-fe84-4913-9ed8-e82a33d77782', '9cb76b0f-bc19-48e2-93fc-082a264727a0'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:06 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153" returned: 0 in 0.409s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1" returned: 0 in 0.437s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:06 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153 Aug 25 07:10:06 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[113875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1 Aug 25 07:10:06 devstack sudo[113875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:06 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.300s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Deleted volume successfully. Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2ffe2a65-c077-46b2-a338-aa8387ed4045 tempest-ProjectReaderTests-964335684 None] Lock "cinder-92cc2981-04a0-4092-ab41-5b8b950d9492-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Acquiring lock "cinder-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "cinder-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Acquiring lock "cinder-quobyte-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:06 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-11742b2f-3525-4851-b42a-24510f4e7153" returned: 0 in 0.430s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack sudo[113875]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-434e5674-2383-4bca-9c92-1d0278d00bf1" returned: 0 in 0.442s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-11742b2f-3525-4851-b42a-24510f4e7153" released by "delete_volume" :: held 0.935s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "cinder-quobyte-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" acquired by "delete_volume" :: waited 0.063s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-quobyte-434e5674-2383-4bca-9c92-1d0278d00bf1" released by "delete_volume" :: held 1.005s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abfc2dd-3423-48ae-a015-a71a26cc1fb5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Created reservations ['f43c8e16-c433-4afa-908f-5343d9d44ace', '907b6a12-fd4f-4385-b33a-f51b665190c3', 'b08231ac-55ce-4aaf-87de-3291e01141d6', 'd787ead0-1be7-4d7b-bddf-8832413f2c61'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Created reservations ['63d50d66-bad4-42b3-870d-0a35c40da44e', '48c0908b-98b0-4321-b5c9-b4a92a6535eb', 'a1ac74a5-1952-4105-9085-bfbccac97cc6', 'c809c2ff-e561-43ec-acce-63b17c9d21e3'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:07 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 Aug 25 07:10:07 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Flow 'volume_create_manager' (2cf73ed1-dffb-43f1-94a4-f97c8098b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753433f-6001-466b-8f98-94480fef8828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753433f-6001-466b-8f98-94480fef8828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689975691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9505a1c7-f305-419b-ba17-3ae1ab0a30c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85944d96957456fb2b29a11ec2f06f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:07Z,use_quota=True,user_id='8020db897286425a86d8befdc32a1a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced6d2c8-902b-490f-8665-aa349a6b3482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced6d2c8-902b-490f-8665-aa349a6b3482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc72a2bc-8df7-4b14-bc0a-bedcc51bfba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc72a2bc-8df7-4b14-bc0a-bedcc51bfba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9505a1c7-f305-419b-ba17-3ae1ab0a30c2', 'volume_name': 'volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712e4c2a-a5ca-4b1b-bea0-00377cc6a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712e4c2a-a5ca-4b1b-bea0-00377cc6a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1cdc9d-ca44-439a-bd0f-ff9897698e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:07 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Volume 9505a1c7-f305-419b-ba17-3ae1ab0a30c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2', 'volume_size': 1} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689975691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9505a1c7-f305-419b-ba17-3ae1ab0a30c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85944d96957456fb2b29a11ec2f06f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:07Z,use_quota=True,user_id='8020db897286425a86d8befdc32a1a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Creating volume 9505a1c7-f305-419b-ba17-3ae1ab0a30c2 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:07 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack sudo[113883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 1073741824 Aug 25 07:10:07 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:07 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:07 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack sudo[113887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:07 devstack sudo[113887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:07 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" returned: 0 in 0.461s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9 Aug 25 07:10:07 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:07 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.321s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:07 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Deleted volume successfully. Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b4c247d-310c-4ead-9e83-566a18859783 tempest-CreateVolumesFromSourceVolumeTest-1661673890 None] Lock "cinder-434e5674-2383-4bca-9c92-1d0278d00bf1-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:07 devstack sudo[113887]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:07 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Deleted volume successfully. Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cc40864-a026-49cb-b3ee-e21a68a10346 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-11742b2f-3525-4851-b42a-24510f4e7153-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:07 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 1073741824" returned: 0 in 0.483s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:07 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "cinder-quobyte-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9" released by "delete_volume" :: held 0.851s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack sudo[113901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 Aug 25 07:10:07 devstack sudo[113901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Created reservations ['09f03e67-90a3-47f0-b630-c17cd445e24a', 'dd2ba3a2-f05f-48fe-8f08-a4dbfe8f063f', '01cca921-79c9-43b6-9b8b-b131463c3c96', '7493e16a-b752-45e4-943a-f3bbb3d5b535'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:07 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:07 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:08 devstack sudo[113901]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1cdc9d-ca44-439a-bd0f-ff9897698e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6b9347-e5be-41bc-afe0-570c162cfb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-ca878834-a6eb-400d-81f3-2efa6e115fa2-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Volume volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 (9505a1c7-f305-419b-ba17-3ae1ab0a30c2): created successfully Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6b9347-e5be-41bc-afe0-570c162cfb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Flow 'volume_create_manager' (2cf73ed1-dffb-43f1-94a4-f97c8098b82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:08 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-ca878834-a6eb-400d-81f3-2efa6e115fa2-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-52e40d6e-2b26-4a77-9cb8-304ad746a5ce tempest-ProjectReaderTests-964335684 None] Created volume successfully. Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.307s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Deleted volume successfully. Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "cinder-quobyte-ca878834-a6eb-400d-81f3-2efa6e115fa2" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6ef946ea-8d08-4ae5-8306-bbd3702a35fc tempest-VolumeAndVolumeTypeFromImageTest-778825884 None] Lock "cinder-0a258dc6-7d06-45d8-b6b3-a7f04eaa15e9-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-ca878834-a6eb-400d-81f3-2efa6e115fa2" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe32bd5-3eeb-499a-a675-508cd2d89cbb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:08 devstack sudo[113907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 Aug 25 07:10:08 devstack sudo[113907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:08 devstack sudo[113907]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2" returned: 0 in 0.400s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:08 devstack sudo[113912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2 Aug 25 07:10:08 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:09 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ca878834-a6eb-400d-81f3-2efa6e115fa2" returned: 0 in 0.281s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-quobyte-ca878834-a6eb-400d-81f3-2efa6e115fa2" released by "delete_volume" :: held 0.727s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Created reservations ['2b599a15-42d4-40f9-a736-afb8aaada862', '7ebf8e53-e618-48f9-a867-ecf7bb50b3d7', '707f8fc0-ceb1-4946-b14e-643210d55f8a', '68c29a04-7bde-4766-ad80-152d4f31bd5b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:09 devstack sudo[113915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:09 devstack sudo[113915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Acquiring lock "cinder-9505a1c7-f305-419b-ba17-3ae1ab0a30c2-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Lock "cinder-9505a1c7-f305-419b-ba17-3ae1ab0a30c2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Acquiring lock "cinder-quobyte-9505a1c7-f305-419b-ba17-3ae1ab0a30c2" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Lock "cinder-quobyte-9505a1c7-f305-419b-ba17-3ae1ab0a30c2" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba27a3-f54f-4b16-a62a-fdb50a9fd4d5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:09 devstack sudo[113915]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.386s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Deleted volume successfully. Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be054a69-8b6e-4d4a-8703-afb95a04bbd3 tempest-VolumeDependencyTests-43059486 None] Lock "cinder-ca878834-a6eb-400d-81f3-2efa6e115fa2-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:09 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 Aug 25 07:10:09 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:09 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2" returned: 0 in 0.451s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:09 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2 Aug 25 07:10:10 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:10 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9505a1c7-f305-419b-ba17-3ae1ab0a30c2" returned: 0 in 0.340s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Lock "cinder-quobyte-9505a1c7-f305-419b-ba17-3ae1ab0a30c2" released by "delete_volume" :: held 0.869s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Created reservations ['a2e62d39-2b22-4af2-b618-75bf1291b36f', '2c6a3c59-23ed-48b6-877e-79b48f56e3ca', '2750a641-cc52-49a0-8a92-b7e06a35aa67', '7f15568c-4c5b-42f4-b875-a8d2835a5298'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:10 devstack sudo[113928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:10 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:10 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.331s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:10 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Deleted volume successfully. Aug 25 07:10:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4c29d729-31a4-4218-8ebe-88d2d30c806a tempest-ProjectReaderTests-964335684 None] Lock "cinder-9505a1c7-f305-419b-ba17-3ae1ab0a30c2-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (12c64bd5-4c9d-4083-b875-89f7e39ae808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925d6298-9496-4852-b527-6a39f68fe932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925d6298-9496-4852-b527-6a39f68fe932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949142506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acde61e8-29f8-4704-a9f7-c1a642d973d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:14Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781a1486-0184-435a-925c-e9e987828ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781a1486-0184-435a-925c-e9e987828ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dccfa72-1708-441f-97d7-4ba42e5877d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dccfa72-1708-441f-97d7-4ba42e5877d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acde61e8-29f8-4704-a9f7-c1a642d973d0', 'volume_name': 'volume-acde61e8-29f8-4704-a9f7-c1a642d973d0', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e18b3e-dae6-48af-9695-857fc0bcda49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e18b3e-dae6-48af-9695-857fc0bcda49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55888318-5c3a-43d6-a0c2-4feeced7333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Volume acde61e8-29f8-4704-a9f7-c1a642d973d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acde61e8-29f8-4704-a9f7-c1a642d973d0', 'volume_size': 1} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949142506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acde61e8-29f8-4704-a9f7-c1a642d973d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:14Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Creating volume acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:14 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:14 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 1073741824 Aug 25 07:10:14 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:14 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 1073741824" returned: 0 in 0.512s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:14 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 Aug 25 07:10:14 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:14 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55888318-5c3a-43d6-a0c2-4feeced7333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acde61e8-29f8-4704-a9f7-c1a642d973d0', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da276567-1133-41f3-bd09-6400b509dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:14 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Volume volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 (acde61e8-29f8-4704-a9f7-c1a642d973d0): created successfully Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da276567-1133-41f3-bd09-6400b509dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:14 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (12c64bd5-4c9d-4083-b875-89f7e39ae808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:15 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d48c57d8-a527-4562-8984-c52d84a06e48 tempest-ProjectReaderTests-1687916709 None] Created volume successfully. Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (bb72d7d1-8343-4046-bb4b-52d35d3de78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157cddb9-5325-4964-8bae-4f4c1ccb31a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157cddb9-5325-4964-8bae-4f4c1ccb31a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1706395624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70aecfa7-068b-4c01-aeb7-d69c255b0bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:16Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83018554-a6f6-4c1c-8dd7-2201b2168765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83018554-a6f6-4c1c-8dd7-2201b2168765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39729e00-b6b3-4184-ba89-393dd6066283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39729e00-b6b3-4184-ba89-393dd6066283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70aecfa7-068b-4c01-aeb7-d69c255b0bfa', 'volume_name': 'volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8bfbec-8ee9-45c2-84b5-901f618267de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8bfbec-8ee9-45c2-84b5-901f618267de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000a10d6-060b-4ff0-948c-be3b028399c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Volume 70aecfa7-068b-4c01-aeb7-d69c255b0bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa', 'volume_size': 1} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1706395624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70aecfa7-068b-4c01-aeb7-d69c255b0bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:16Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Creating volume 70aecfa7-068b-4c01-aeb7-d69c255b0bfa {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:16 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:16 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa 1073741824 Aug 25 07:10:16 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (a38ab98f-2d9c-43e6-ab61-51509220754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3abb1e-9b6b-4aae-8158-a92843163f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3abb1e-9b6b-4aae-8158-a92843163f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2046838605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516d0d95-cf16-4dcb-aa61-043db82d6652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:17Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562d3486-3420-41fb-82c7-fbab00e5bc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562d3486-3420-41fb-82c7-fbab00e5bc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b62ccd5-7e1c-4202-861f-ec3061da4340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b62ccd5-7e1c-4202-861f-ec3061da4340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516d0d95-cf16-4dcb-aa61-043db82d6652', 'volume_name': 'volume-516d0d95-cf16-4dcb-aa61-043db82d6652', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a68b47b-2116-448b-9d92-a91228cb7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a68b47b-2116-448b-9d92-a91228cb7c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093922df-6f48-4cde-9acf-430de8216106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Volume 516d0d95-cf16-4dcb-aa61-043db82d6652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516d0d95-cf16-4dcb-aa61-043db82d6652', 'volume_size': 1} Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:16 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa 1073741824" returned: 0 in 0.713s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:17 devstack sudo[113947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa Aug 25 07:10:17 devstack sudo[113947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (ee63f213-56d9-411a-ac0f-3aaa26c27aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe58fda1-0b69-4b65-94dc-624e6ce8e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe58fda1-0b69-4b65-94dc-624e6ce8e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882873100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee30077-4903-4cd9-98fb-1c972b64239b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:17Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ffe8f7-a209-406a-a231-1e82834a8bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ffe8f7-a209-406a-a231-1e82834a8bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2d4494-b54b-485b-ad3e-993f125312a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2d4494-b54b-485b-ad3e-993f125312a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee30077-4903-4cd9-98fb-1c972b64239b', 'volume_name': 'volume-1ee30077-4903-4cd9-98fb-1c972b64239b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a9a3e8-f581-439d-8565-d4d4f12ce485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a9a3e8-f581-439d-8565-d4d4f12ce485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f39045-6730-4a1b-9e63-0dff9035d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Volume 1ee30077-4903-4cd9-98fb-1c972b64239b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee30077-4903-4cd9-98fb-1c972b64239b', 'volume_size': 1} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:17 devstack sudo[113947]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa" returned: 0 in 0.466s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.778s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000a10d6-060b-4ff0-948c-be3b028399c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fe42ad-9c68-4bdc-be84-a8a89fa25fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Creating offline snapshot 91387154-e2ee-4832-81b4-096effc6d5fb of volume acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:17 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Volume volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa (70aecfa7-068b-4c01-aeb7-d69c255b0bfa): created successfully Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fe42ad-9c68-4bdc-be84-a8a89fa25fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (bb72d7d1-8343-4046-bb4b-52d35d3de78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[78678916-b105-4696-b2df-c36f482793d7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b2a40eeb-c07c-48b0-95e9-9e1e4d3db7fb tempest-CreateVolumesFromImageTest-370031478 None] Created volume successfully. Aug 25 07:10:17 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 Aug 25 07:10:17 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (48b02106-c7fb-4abf-9dd6-4b9ee514dac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d171a006-4d61-4395-93f5-966ed1b985e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d171a006-4d61-4395-93f5-966ed1b985e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1953338747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9425ba-0864-4975-9bde-fb984b786f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:18Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08297c82-dadd-4158-931b-495b001ebd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08297c82-dadd-4158-931b-495b001ebd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e545cb0-0fcc-4da9-873e-143afbe4bc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e545cb0-0fcc-4da9-873e-143afbe4bc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9425ba-0864-4975-9bde-fb984b786f14', 'volume_name': 'volume-ac9425ba-0864-4975-9bde-fb984b786f14', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb0d38-39ea-4157-9693-77a079eb7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:17 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb0d38-39ea-4157-9693-77a079eb7c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ed3866-8f61-45ca-bb4b-88720c31e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Volume ac9425ba-0864-4975-9bde-fb984b786f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9425ba-0864-4975-9bde-fb984b786f14', 'volume_size': 1} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:18 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0" returned: 0 in 0.674s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:18 devstack sudo[113956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb 1G Aug 25 07:10:18 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (e0731222-0be1-488d-a3eb-91ba3d732591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e04fde-9c8f-4a8b-a3e1-d596bd8455e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e04fde-9c8f-4a8b-a3e1-d596bd8455e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095024021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ce7435-5378-4534-ac22-9934b2567748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:18Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbcf3b3-47bd-41be-9f69-af75c01a3011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbcf3b3-47bd-41be-9f69-af75c01a3011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73c37a0-6da9-432c-acc5-60f5aefef66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73c37a0-6da9-432c-acc5-60f5aefef66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ce7435-5378-4534-ac22-9934b2567748', 'volume_name': 'volume-c9ce7435-5378-4534-ac22-9934b2567748', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f736e92d-8b57-4d23-b995-ab479eb18ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f736e92d-8b57-4d23-b995-ab479eb18ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c079108-0575-41f4-8f16-0a8d12a174f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Volume c9ce7435-5378-4534-ac22-9934b2567748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ce7435-5378-4534-ac22-9934b2567748', 'volume_size': 1} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Flow 'volume_create_manager' (a8e82943-d29e-4bea-84ce-35ba44918117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dd06ee-291d-4ca1-8022-0e89187982ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dd06ee-291d-4ca1-8022-0e89187982ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b2912693e245efa15ff0c01a3830a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:19Z,use_quota=True,user_id='c4f2f72c94e2497b9933e525c613c858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eba28e9-0933-4508-93e4-e939e652b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eba28e9-0933-4508-93e4-e939e652b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6da9cf0-ce9c-4a8c-92e2-95e0b7a627c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG cinder.image.glance [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Creating Keystone auth plugin from conf {{(pid=94460) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 25 07:10:18 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb 1G" returned: 0 in 0.567s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:18 devstack sudo[113961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb Aug 25 07:10:18 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6da9cf0-ce9c-4a8c-92e2-95e0b7a627c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac', 'volume_name': 'volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac', 'volume_size': 1, 'image_id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '987af94885009a8aa34fdb3d6617ed22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b2912693e245efa15ff0c01a3830a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca7e21f09a00a2d5e1e970194183b35652d2c23622e7c681e2c77b8baea70614b64dfcbe24416ef1576728f93cecce441722674b9f3ee6d83aeab1970c760869', 'id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'created_at': datetime.datetime(2026, 8, 25, 5, 10, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 10, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a/file', 'properties': {}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d5e18-b203-4160-819f-701c6c6e94b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1d5e18-b203-4160-819f-701c6c6e94b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4ceef-e1b8-4566-ad56-e49617dba457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Volume 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac', 'volume_size': 1, 'image_id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '987af94885009a8aa34fdb3d6617ed22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b2912693e245efa15ff0c01a3830a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca7e21f09a00a2d5e1e970194183b35652d2c23622e7c681e2c77b8baea70614b64dfcbe24416ef1576728f93cecce441722674b9f3ee6d83aeab1970c760869', 'id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'created_at': datetime.datetime(2026, 8, 25, 5, 10, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 10, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a/file', 'properties': {}}, 'image_service': } Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Trying to clone 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac from image 52836daf-24bd-4a42-9ebf-4fb7d6db342a at location (None, [{'url': 'file:///opt/stack/data/glance/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'metadata': {}}]). {{(pid=94460) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 25 07:10:19 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb" returned: 0 in 0.341s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb is being set with open permissions: ugo+rw Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[113966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb Aug 25 07:10:19 devstack sudo[113966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 25 07:10:19 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Image download 0.00 MB at 0.00 MB/s Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[167e915c-6f20-4979-92fb-67a9d0351605]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[113968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD Aug 25 07:10:19 devstack sudo[113968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack sudo[113966]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[113971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info Aug 25 07:10:19 devstack sudo[113971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack sudo[113968]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[113975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD Aug 25 07:10:19 devstack sudo[113971]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:19 devstack sudo[113975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info" returned: 0 in 0.306s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:19 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info is being set with open permissions: ugo+rw Aug 25 07:10:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:19 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info Aug 25 07:10:19 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:20 devstack sudo[113975]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Temporary image 52836daf-24bd-4a42-9ebf-4fb7d6db342a is fetched for user c4f2f72c94e2497b9933e525c613c858. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 25 07:10:20 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.info" returned: 0 in 0.283s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2046838605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516d0d95-cf16-4dcb-aa61-043db82d6652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:17Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Creating volume 516d0d95-cf16-4dcb-aa61-043db82d6652 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:20 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e6c8ae-2b66-4454-8d97-f536dfe74ac7]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:20 devstack sudo[113985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 1073741824 Aug 25 07:10:20 devstack sudo[113985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:20 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-403da220-9fd0-4d75-9d61-d3eafd0b2f6d tempest-ProjectReaderTests-1687916709 None] Create snapshot completed successfully Aug 25 07:10:20 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD Aug 25 07:10:20 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:20 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:20 devstack sudo[113985]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 1073741824" returned: 0 in 0.526s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:20 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD Aug 25 07:10:20 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:20 devstack sudo[113996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 Aug 25 07:10:20 devstack sudo[113996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:20 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD" returned: 1 in 0.397s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-91387154-e2ee-4832-81b4-096effc6d5fb-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-91387154-e2ee-4832-81b4-096effc6d5fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-acde61e8-29f8-4704-a9f7-c1a642d973d0" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-acde61e8-29f8-4704-a9f7-c1a642d973d0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-91387154-e2ee-4832-81b4-096effc6d5fb" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:21 devstack sudo[113996]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652" returned: 0 in 0.328s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.779s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882873100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee30077-4903-4cd9-98fb-1c972b64239b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:17Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Creating volume 1ee30077-4903-4cd9-98fb-1c972b64239b {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:21 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-91387154-e2ee-4832-81b4-096effc6d5fb" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Deleting offline snapshot 91387154-e2ee-4832-81b4-096effc6d5fb of volume acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:21 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b 1073741824 Aug 25 07:10:21 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] snapshot_file for this snap is: volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093922df-6f48-4cde-9acf-430de8216106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516d0d95-cf16-4dcb-aa61-043db82d6652', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe93a6a7-054e-428c-b60a-6173edd446cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c85f52-47ec-49c3-9a35-e79f790c4bbe]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Volume volume-516d0d95-cf16-4dcb-aa61-043db82d6652 (516d0d95-cf16-4dcb-aa61-043db82d6652): created successfully Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe93a6a7-054e-428c-b60a-6173edd446cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (a38ab98f-2d9c-43e6-ab61-51509220754f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0ce06d07-6f12-4a11-bcea-da8ae70e74aa tempest-CreateVolumesFromImageTest-370031478 None] Created volume successfully. Aug 25 07:10:21 devstack sudo[114005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb Aug 25 07:10:21 devstack sudo[114005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:21 devstack sudo[114005]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acde61e8-29f8-4704-a9f7-c1a642d973d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba12bc-e290-44d3-8572-0e8cdf784415]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b 1073741824" returned: 0 in 0.527s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b Aug 25 07:10:21 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:21 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 Aug 25 07:10:21 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:21 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b" returned: 0 in 0.305s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.951s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1953338747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9425ba-0864-4975-9bde-fb984b786f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:18Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Creating volume ac9425ba-0864-4975-9bde-fb984b786f14 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:21 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f39045-6730-4a1b-9e63-0dff9035d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee30077-4903-4cd9-98fb-1c972b64239b', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:21 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1a4650-c987-4dd8-baa8-a74ffb938c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:21 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 1073741824 Aug 25 07:10:21 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Volume volume-1ee30077-4903-4cd9-98fb-1c972b64239b (1ee30077-4903-4cd9-98fb-1c972b64239b): created successfully Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1a4650-c987-4dd8-baa8-a74ffb938c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (ee63f213-56d9-411a-ac0f-3aaa26c27aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:22 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-591184da-d4e5-4776-bcb9-faacb2ed4c8d tempest-CreateVolumesFromImageTest-370031478 None] Created volume successfully. Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0" returned: 0 in 0.462s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:22 devstack sudo[114024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb Aug 25 07:10:22 devstack sudo[114024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack sudo[114024]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb" returned: 0 in 0.382s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:22 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 1073741824" returned: 0 in 0.476s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack sudo[114034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb Aug 25 07:10:22 devstack sudo[114034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:22 devstack sudo[114036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 Aug 25 07:10:22 devstack sudo[114036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack sudo[114034]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0.91387154-e2ee-4832-81b4-096effc6d5fb" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-91387154-e2ee-4832-81b4-096effc6d5fb" released by "_delete_snapshot" :: held 1.662s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:22 devstack sudo[114036]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-acde61e8-29f8-4704-a9f7-c1a642d973d0" released by "delete_snapshot" :: held 1.730s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.125s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095024021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ce7435-5378-4534-ac22-9934b2567748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158e73d081524e5a8b3a8f73932db2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:18Z,use_quota=True,user_id='8638fa49c4dc41e784e482daf67f5019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Creating volume c9ce7435-5378-4534-ac22-9934b2567748 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:22 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ed3866-8f61-45ca-bb4b-88720c31e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9425ba-0864-4975-9bde-fb984b786f14', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:22 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 1073741824 Aug 25 07:10:22 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b599355-70cd-482e-be4c-4b630d427df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:22 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Volume volume-ac9425ba-0864-4975-9bde-fb984b786f14 (ac9425ba-0864-4975-9bde-fb984b786f14): created successfully Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b599355-70cd-482e-be4c-4b630d427df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (48b02106-c7fb-4abf-9dd6-4b9ee514dac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0d242d44-de70-4172-b1e2-abb6c58cb738 tempest-CreateVolumesFromImageTest-370031478 None] Created volume successfully. Aug 25 07:10:22 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Created reservations ['9912464f-9e0b-4a7d-8460-a211c3a4c335', '15a2973a-c854-40c1-b659-c55d11f74f70', 'cb5186ac-b679-41e7-ac40-c88ef69d9e33', 'da85826c-7479-412e-b586-5be1cd2dfcc7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Delete snapshot completed successfully. Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-87aaaa82-d3fd-4323-ab6e-7e337c220249 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-91387154-e2ee-4832-81b4-096effc6d5fb-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-acde61e8-29f8-4704-a9f7-c1a642d973d0-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-acde61e8-29f8-4704-a9f7-c1a642d973d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-acde61e8-29f8-4704-a9f7-c1a642d973d0" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-acde61e8-29f8-4704-a9f7-c1a642d973d0" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0101e-c426-4c6f-8eb1-f13fb7c8fdfd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:23 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 1073741824" returned: 0 in 0.657s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:23 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 Aug 25 07:10:23 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:23 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 Aug 25 07:10:23 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:23 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0" returned: 0 in 0.421s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:23 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748" returned: 0 in 0.307s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.813s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b2912693e245efa15ff0c01a3830a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:19Z,use_quota=True,user_id='c4f2f72c94e2497b9933e525c613c858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:23 devstack sudo[114094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0 Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Creating volume 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:23 devstack sudo[114094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:23 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c079108-0575-41f4-8f16-0a8d12a174f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ce7435-5378-4534-ac22-9934b2567748', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:23 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac 1073741824 Aug 25 07:10:23 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4db00e-1b27-48c5-a3d9-e3a568ae6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:23 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Volume volume-c9ce7435-5378-4534-ac22-9934b2567748 (c9ce7435-5378-4534-ac22-9934b2567748): created successfully Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4db00e-1b27-48c5-a3d9-e3a568ae6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:23 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Flow 'volume_create_manager' (e0731222-0be1-488d-a3eb-91ba3d732591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6099abba-1322-450a-b949-f6fd8471b3eb tempest-CreateVolumesFromImageTest-370031478 None] Created volume successfully. Aug 25 07:10:24 devstack sudo[114094]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-acde61e8-29f8-4704-a9f7-c1a642d973d0" returned: 0 in 0.342s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-acde61e8-29f8-4704-a9f7-c1a642d973d0" released by "delete_volume" :: held 0.838s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-c9ce7435-5378-4534-ac22-9934b2567748-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-c9ce7435-5378-4534-ac22-9934b2567748-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Created reservations ['7e3475cf-748c-4129-800c-f9b3850500ab', 'fd1c5a83-bc7b-4f6f-8934-9f7952f4ebf8', 'c883eae8-592b-487e-8e54-9d9ad6081476', 'c08ab5d5-4779-4ea2-8ebe-986f286cc2d7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-quobyte-c9ce7435-5378-4534-ac22-9934b2567748" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-c9ce7435-5378-4534-ac22-9934b2567748" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2595c017-8fcf-4422-a96d-3020f5b483dd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack sudo[114104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:24 devstack sudo[114104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:24 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac 1073741824" returned: 0 in 0.633s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 Aug 25 07:10:24 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac Aug 25 07:10:24 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:24 devstack sudo[114104]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.416s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Deleted volume successfully. Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-139b277e-c4e0-4d17-9e05-f341a6b64523 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-acde61e8-29f8-4704-a9f7-c1a642d973d0-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:24 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748" returned: 0 in 0.575s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:24 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:24 devstack sudo[114114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748 Aug 25 07:10:24 devstack sudo[114114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:24 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Attempting download of 52836daf-24bd-4a42-9ebf-4fb7d6db342a ((None, [{'url': 'file:///opt/stack/data/glance/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'metadata': {}}])) to volume 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (5957e2b0-a1ea-4c99-a39d-6e0862b25b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfde1c0d-594c-4975-aa58-f949512df55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb156d4-cbe7-4858-ba3f-88d7518deda7]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfde1c0d-594c-4975-aa58-f949512df55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1409920890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5911054a-9f08-4287-98b4-d13d45251887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:25Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b60798-7440-4436-95fa-e49423e219c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b60798-7440-4436-95fa-e49423e219c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b36012-6d63-434e-8433-9d5446e9fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b36012-6d63-434e-8433-9d5446e9fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5911054a-9f08-4287-98b4-d13d45251887', 'volume_name': 'volume-5911054a-9f08-4287-98b4-d13d45251887', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f22aae8-7153-4da9-933e-092c3466764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f22aae8-7153-4da9-933e-092c3466764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d273fa-c31f-4b4e-9c42-fba6954d721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:25 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Volume 5911054a-9f08-4287-98b4-d13d45251887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5911054a-9f08-4287-98b4-d13d45251887', 'volume_size': 1} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1409920890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5911054a-9f08-4287-98b4-d13d45251887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:25Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Creating volume 5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:25 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:25 devstack sudo[114114]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9ce7435-5378-4534-ac22-9934b2567748" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:25 devstack sudo[114118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 1073741824 Aug 25 07:10:25 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-c9ce7435-5378-4534-ac22-9934b2567748" released by "delete_volume" :: held 0.985s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:25 devstack sudo[114116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp Aug 25 07:10:25 devstack sudo[114116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Created reservations ['3c2d53c5-8b5a-4955-b799-2669e9c2b5dc', '727057dd-79cc-4d24-bad2-966414c3ef23', 'e8e78599-0571-4c9d-850d-e5427c3c0b7c', '67998f21-6b57-418c-bbd7-67db8fb6adc1'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:25 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:25 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:25 devstack sudo[114116]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp" returned: 0 in 0.529s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:25 devstack sudo[114128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp Aug 25 07:10:25 devstack sudo[114128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:25 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 1073741824" returned: 0 in 0.606s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:25 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Deleted volume successfully. Aug 25 07:10:25 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 Aug 25 07:10:25 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e927887c-66b5-442d-b00d-9062f11c7efe tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-c9ce7435-5378-4534-ac22-9934b2567748-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:26 devstack sudo[114128]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp" returned: 1 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52836daf-24bd-4a42-9ebf-4fb7d6db342a_19hjfesp' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e62721-49f8-4a80-9dfa-af77257fbd8f]: (4, 'raw') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:26 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD Aug 25 07:10:26 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:26 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d273fa-c31f-4b4e-9c42-fba6954d721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5911054a-9f08-4287-98b4-d13d45251887', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419056de-a082-4503-8f17-d7061733e518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:26 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Volume volume-5911054a-9f08-4287-98b4-d13d45251887 (5911054a-9f08-4287-98b4-d13d45251887): created successfully Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419056de-a082-4503-8f17-d7061733e518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (5957e2b0-a1ea-4c99-a39d-6e0862b25b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2df2fe06-c48c-4b80-a672-ebcb21879350 tempest-ProjectReaderTests-1687916709 None] Created volume successfully. Aug 25 07:10:26 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-ac9425ba-0864-4975-9bde-fb984b786f14-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-ac9425ba-0864-4975-9bde-fb984b786f14-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:26 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD Aug 25 07:10:26 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-quobyte-ac9425ba-0864-4975-9bde-fb984b786f14" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-ac9425ba-0864-4975-9bde-fb984b786f14" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750261d-e023-4007-ba70-acbf098cfa7d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:26 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 Aug 25 07:10:26 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:26 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] 52836daf-24bd-4a42-9ebf-4fb7d6db342a was raw, converting to qcow2 {{(pid=94460) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 25 07:10:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:26 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac Aug 25 07:10:26 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:27 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14" returned: 0 in 0.438s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:27 devstack sudo[114153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14 Aug 25 07:10:27 devstack sudo[114153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:27 devstack sudo[114153]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-ac9425ba-0864-4975-9bde-fb984b786f14" returned: 0 in 0.257s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-ac9425ba-0864-4975-9bde-fb984b786f14" released by "delete_volume" :: held 0.761s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Creating offline snapshot de820398-c07e-4a24-9122-91ae9e240306 of volume 5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[24365f19-377c-44c9-8ef5-05e2d391ee7c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Created reservations ['651285ee-007b-4e88-a893-28bf5a78663d', 'c3833f85-9465-48d5-a1f9-8d25dcbd18c6', 'a90a9999-e72e-421e-a4e6-e528d47f67ab', 'b7ef8991-b932-4add-a6ce-cf48b567e043'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:27 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" returned: 0 in 0.631s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52836daf-24bd-4a42-9ebf-4fb7d6db342a_un66yep5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:10:27 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Converted 0.00 MB image at 0.00 MB/s Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:27 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac 1G Aug 25 07:10:27 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:27 devstack sudo[114160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 Aug 25 07:10:27 devstack sudo[114160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:27 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:27 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-1ee30077-4903-4cd9-98fb-1c972b64239b-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-1ee30077-4903-4cd9-98fb-1c972b64239b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-quobyte-1ee30077-4903-4cd9-98fb-1c972b64239b" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-1ee30077-4903-4cd9-98fb-1c972b64239b" acquired by "delete_volume" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:27 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac 1G" returned: 0 in 0.547s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Downloaded image 52836daf-24bd-4a42-9ebf-4fb7d6db342a ((None, [{'url': 'file:///opt/stack/data/glance/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'metadata': {}}])) to volume 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac successfully. {{(pid=94460) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Temporary image 52836daf-24bd-4a42-9ebf-4fb7d6db342a for user c4f2f72c94e2497b9933e525c613c858 is deleted. {{(pid=94460) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.volume_utils [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Marking volume 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac as bootable. {{(pid=94460) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc6058a-ab87-471b-993d-e424e868daa0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:28 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.450s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Deleted volume successfully. Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Copying metadata from image 52836daf-24bd-4a42-9ebf-4fb7d6db342a to 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac. {{(pid=94460) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Creating volume glance metadata for volume 8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac backed by image 52836daf-24bd-4a42-9ebf-4fb7d6db342a with: {'image_id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '987af94885009a8aa34fdb3d6617ed22', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94460) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 25 07:10:28 devstack sudo[114160]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1c3c36b4-f481-4eac-8997-7832a6f93bfb tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-ac9425ba-0864-4975-9bde-fb984b786f14-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887" returned: 0 in 0.715s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:28 devstack sudo[114174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 1G Aug 25 07:10:28 devstack sudo[114174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4ceef-e1b8-4566-ad56-e49617dba457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac', 'volume_size': 1, 'image_id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '987af94885009a8aa34fdb3d6617ed22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b2912693e245efa15ff0c01a3830a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca7e21f09a00a2d5e1e970194183b35652d2c23622e7c681e2c77b8baea70614b64dfcbe24416ef1576728f93cecce441722674b9f3ee6d83aeab1970c760869', 'id': '52836daf-24bd-4a42-9ebf-4fb7d6db342a', 'created_at': datetime.datetime(2026, 8, 25, 5, 10, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 5, 10, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52836daf-24bd-4a42-9ebf-4fb7d6db342a/file', 'properties': {}}, 'image_service': }' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:28 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b Aug 25 07:10:28 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bf0a53-0825-4b89-bc67-177f862f5f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:28 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Volume volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac (8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac): created successfully Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bf0a53-0825-4b89-bc67-177f862f5f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Flow 'volume_create_manager' (a8e82943-d29e-4bea-84ce-35ba44918117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-dc7af485-8adf-41b9-aaa9-e6757957bc3c tempest-VolumeImageDependencyTests-875945066 None] Created volume successfully. Aug 25 07:10:28 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b" returned: 0 in 0.458s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:28 devstack sudo[114184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b Aug 25 07:10:28 devstack sudo[114184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:28 devstack sudo[114174]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 1G" returned: 0 in 0.450s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5911054a-9f08-4287-98b4-d13d45251887 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:28 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5911054a-9f08-4287-98b4-d13d45251887 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 Aug 25 07:10:28 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:28 devstack sudo[114184]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-1ee30077-4903-4cd9-98fb-1c972b64239b" returned: 0 in 0.282s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-1ee30077-4903-4cd9-98fb-1c972b64239b" released by "delete_volume" :: held 0.839s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Acquiring lock "cinder-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Lock "cinder-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Acquiring lock "cinder-quobyte-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Lock "cinder-quobyte-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" acquired by "delete_volume" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:29 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc863abc-30b8-4d61-bffe-d41ef0180491]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5911054a-9f08-4287-98b4-d13d45251887 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306" returned: 0 in 0.449s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 is being set with open permissions: ugo+rw Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Created reservations ['933d1c78-1412-4ab4-8334-59473bd7f9b8', '32c636ab-94d3-4cef-bbdc-d073e8023825', '58d6228c-7f07-4969-9be6-3b4fb6f9442d', 'ebd4fdd3-85e3-40db-86cc-0a89f3ebaf73'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:29 devstack sudo[114193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 Aug 25 07:10:29 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:29 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:29 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306" returned: 0 in 0.308s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info Aug 25 07:10:29 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:29 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Deleted volume successfully. Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-89f9ac99-1325-45c7-a9f2-688cca02baf6 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-1ee30077-4903-4cd9-98fb-1c972b64239b-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:29 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" returned: 0 in 0.484s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac Aug 25 07:10:29 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info is being set with open permissions: ugo+rw Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info Aug 25 07:10:29 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Lock "cinder-quobyte-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac" released by "delete_volume" :: held 0.807s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Created reservations ['159f8a82-31ff-4e74-9129-eb44bcb66e72', '0619182d-9038-4c36-b796-a1625533e2f2', 'a194a775-7420-409b-95ea-de17ad9d5e19', 'f5c408e7-984f-4f3e-8080-2890591dc37a'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:29 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.info" returned: 0 in 0.294s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:29 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:29 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:29 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-17e7965c-fe69-4276-9634-f83238a8bd91 tempest-ProjectReaderTests-1687916709 None] Create snapshot completed successfully Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-516d0d95-cf16-4dcb-aa61-043db82d6652-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-516d0d95-cf16-4dcb-aa61-043db82d6652-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:30 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-quobyte-516d0d95-cf16-4dcb-aa61-043db82d6652" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.305s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:30 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Deleted volume successfully. Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-516d0d95-cf16-4dcb-aa61-043db82d6652" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-69139711-958d-4b85-864d-e56f12315432 tempest-VolumeImageDependencyTests-875945066 None] Lock "cinder-8ce4aa9b-b8bd-487e-9403-a0ce401ae8ac-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503114a-f82c-4e71-ae3f-f6dd7a06e9b9]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:30 devstack sudo[114216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 Aug 25 07:10:30 devstack sudo[114216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-de820398-c07e-4a24-9122-91ae9e240306-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Lock "cinder-de820398-c07e-4a24-9122-91ae9e240306-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-5911054a-9f08-4287-98b4-d13d45251887" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-5911054a-9f08-4287-98b4-d13d45251887" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-de820398-c07e-4a24-9122-91ae9e240306" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-de820398-c07e-4a24-9122-91ae9e240306" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Deleting offline snapshot de820398-c07e-4a24-9122-91ae9e240306 of volume 5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] snapshot_file for this snap is: volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda42fe2-7e26-458f-ba09-51d5ce64f61a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:30 devstack sudo[114216]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652" returned: 0 in 0.514s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:30 devstack sudo[114222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652 Aug 25 07:10:30 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 Aug 25 07:10:30 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:30 devstack sudo[114222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:31 devstack sudo[114222]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-516d0d95-cf16-4dcb-aa61-043db82d6652" returned: 0 in 0.331s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-516d0d95-cf16-4dcb-aa61-043db82d6652" released by "delete_volume" :: held 0.916s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:31 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306" returned: 0 in 0.490s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5911054a-9f08-4287-98b4-d13d45251887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c843c4f-2d1b-4df5-bd57-105cb5a1cc42]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Created reservations ['806da8f9-1742-46c5-8a76-76cb994914a6', '984d86e5-be37-448c-926d-425173b2d851', 'ace20e79-1d7a-4879-b70b-1865c636d9f1', '284bb967-7610-4c31-a907-43c83b331548'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:31 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 Aug 25 07:10:31 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:31 devstack sudo[114231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:31 devstack sudo[114231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:31 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887" returned: 0 in 0.440s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:31 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 Aug 25 07:10:31 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:31 devstack sudo[114231]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.342s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:31 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Deleted volume successfully. Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:31 devstack sudo[114239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:31 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:31 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-4e348770-e3dd-47a2-8b52-fedab817477c tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-516d0d95-cf16-4dcb-aa61-043db82d6652-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:32 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.358s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:10:32 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306" returned: 0 in 0.545s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:32 devstack sudo[114246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306 Aug 25 07:10:32 devstack sudo[114246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-70aecfa7-068b-4c01-aeb7-d69c255b0bfa-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-70aecfa7-068b-4c01-aeb7-d69c255b0bfa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "cinder-quobyte-70aecfa7-068b-4c01-aeb7-d69c255b0bfa" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:32 devstack sudo[114246]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-70aecfa7-068b-4c01-aeb7-d69c255b0bfa" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887.de820398-c07e-4a24-9122-91ae9e240306" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c338ac5-312b-4427-a85a-01e9e12e111a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-de820398-c07e-4a24-9122-91ae9e240306" released by "_delete_snapshot" :: held 1.969s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-5911054a-9f08-4287-98b4-d13d45251887" released by "delete_snapshot" :: held 2.010s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:32 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa Aug 25 07:10:32 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Created reservations ['77c5f4aa-c1c3-4f04-b8cb-eb1b43b6f4dc', 'cf944eae-5bb0-4c84-8b73-a528624b2619', 'b013d51a-a60b-4cc8-81d9-252a1178ee16', 'c66f46f7-0233-4a2d-903d-f9b392d89fcd'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Delete snapshot completed successfully. Aug 25 07:10:32 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-403ca3e4-50d0-4736-a782-19fca85ff2bd tempest-ProjectReaderTests-1687916709 None] Lock "cinder-de820398-c07e-4a24-9122-91ae9e240306-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:33 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa" returned: 0 in 0.425s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:33 devstack sudo[114262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa Aug 25 07:10:33 devstack sudo[114262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:33 devstack sudo[114262]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-70aecfa7-068b-4c01-aeb7-d69c255b0bfa" returned: 0 in 0.262s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-quobyte-70aecfa7-068b-4c01-aeb7-d69c255b0bfa" released by "delete_volume" :: held 0.747s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Created reservations ['4f3aa61d-fb74-4107-b057-1ff05647aeb8', '35d75b26-67e2-47e6-8334-ea08fbed1449', '71f95de4-7a12-4496-acf2-62ca825fb728', '24d1ba26-4616-4b6d-96fd-5bc9288ce215'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:33 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:33 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:33 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.306s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:33 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Deleted volume successfully. Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-35cca36a-f082-4314-8a2a-8fab69b165f4 tempest-CreateVolumesFromImageTest-370031478 None] Lock "cinder-70aecfa7-068b-4c01-aeb7-d69c255b0bfa-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-5911054a-9f08-4287-98b4-d13d45251887-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-5911054a-9f08-4287-98b4-d13d45251887-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-5911054a-9f08-4287-98b4-d13d45251887" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-5911054a-9f08-4287-98b4-d13d45251887" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e37a171-5ba1-45d5-b86b-2865dc75af2f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:34 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 Aug 25 07:10:34 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Flow 'volume_create_manager' (c84d1cf9-1300-44ed-aaf4-34afacddfe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feee8803-6a2f-45de-94d5-f4c0d4288d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feee8803-6a2f-45de-94d5-f4c0d4288d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a470684d-fe55-4516-a8b9-d7e7e65a701e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94549488b8524ac382bf86047a38e36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:34Z,use_quota=True,user_id='6519d121f4ad43e9acb3d92139edc8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b508aedf-e3bf-48d2-9eb8-0b5bab7d014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b508aedf-e3bf-48d2-9eb8-0b5bab7d014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ad483f-941d-49ad-b339-9dbacf9d8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ad483f-941d-49ad-b339-9dbacf9d8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a470684d-fe55-4516-a8b9-d7e7e65a701e', 'volume_name': 'volume-a470684d-fe55-4516-a8b9-d7e7e65a701e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77756db-e731-4d19-8bd3-8faca11ed5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77756db-e731-4d19-8bd3-8faca11ed5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81e902e-6c08-49a5-9be4-a363f2a0fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:34 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Volume a470684d-fe55-4516-a8b9-d7e7e65a701e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a470684d-fe55-4516-a8b9-d7e7e65a701e', 'volume_size': 1} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a470684d-fe55-4516-a8b9-d7e7e65a701e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94549488b8524ac382bf86047a38e36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:34Z,use_quota=True,user_id='6519d121f4ad43e9acb3d92139edc8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Creating volume a470684d-fe55-4516-a8b9-d7e7e65a701e {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:34 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:34 devstack sudo[114270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e 1073741824 Aug 25 07:10:34 devstack sudo[114270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:34 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887" returned: 0 in 0.633s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:34 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887 Aug 25 07:10:34 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:35 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-5911054a-9f08-4287-98b4-d13d45251887" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-5911054a-9f08-4287-98b4-d13d45251887" released by "delete_volume" :: held 1.089s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:35 devstack sudo[114270]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e 1073741824" returned: 0 in 0.709s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Created reservations ['5243f58c-0de0-45ea-a8ec-41064ae414fe', '4897f560-2597-4a83-a150-a670cd3c4805', 'c2031720-73ed-4098-84eb-7b247210c904', '355722af-351b-4db8-8294-0a3542fe4ab8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:35 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e Aug 25 07:10:35 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:35 devstack sudo[114284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:35 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:35 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e" returned: 0 in 0.312s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81e902e-6c08-49a5-9be4-a363f2a0fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a470684d-fe55-4516-a8b9-d7e7e65a701e', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3f943b-924c-4705-996f-5e8f0eaa7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:35 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Volume volume-a470684d-fe55-4516-a8b9-d7e7e65a701e (a470684d-fe55-4516-a8b9-d7e7e65a701e): created successfully Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3f943b-924c-4705-996f-5e8f0eaa7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Flow 'volume_create_manager' (c84d1cf9-1300-44ed-aaf4-34afacddfe6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:35 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a8538265-5036-470d-b1fb-32f2b2005fa1 tempest-CinderUnicodeTest-1822153084 None] Created volume successfully. Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.352s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Deleted volume successfully. Aug 25 07:10:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9e66b1af-bbea-4d03-a084-649fb7dcac84 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-5911054a-9f08-4287-98b4-d13d45251887-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (4eb368ab-3180-4465-afa0-521db2cd0295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae9b070-fb4d-482a-b5dc-ff1196e31387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae9b070-fb4d-482a-b5dc-ff1196e31387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864148851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9add703-3fc6-413a-a35a-8894dd6f1d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:37Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d080d2-d429-423f-8303-00313fdb68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d080d2-d429-423f-8303-00313fdb68c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96adf60-830a-421b-8def-29b364ea721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96adf60-830a-421b-8def-29b364ea721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9add703-3fc6-413a-a35a-8894dd6f1d81', 'volume_name': 'volume-c9add703-3fc6-413a-a35a-8894dd6f1d81', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594599b2-e077-4fe3-92ed-f0ec04d7ca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594599b2-e077-4fe3-92ed-f0ec04d7ca81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed07556a-a354-44ca-a861-d7792f6bb886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Volume c9add703-3fc6-413a-a35a-8894dd6f1d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9add703-3fc6-413a-a35a-8894dd6f1d81', 'volume_size': 1} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864148851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9add703-3fc6-413a-a35a-8894dd6f1d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:37Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Creating volume c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:37 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:37 devstack sudo[114288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 1073741824 Aug 25 07:10:37 devstack sudo[114288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Flow 'volume_create_manager' (809217dc-6ca0-4f2e-93f0-b6ef38262eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9017dc43-498d-44d3-986a-5b5d51e6261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9017dc43-498d-44d3-986a-5b5d51e6261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-747321876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307f5db8-e239-4db3-bc4e-be4c4a5611b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94549488b8524ac382bf86047a38e36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:37Z,use_quota=True,user_id='6519d121f4ad43e9acb3d92139edc8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5875b8c8-d9b9-45a1-8f07-47d946673252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5875b8c8-d9b9-45a1-8f07-47d946673252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab8034b-3e0d-4512-98a7-d39f8aa01f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab8034b-3e0d-4512-98a7-d39f8aa01f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307f5db8-e239-4db3-bc4e-be4c4a5611b5', 'volume_name': 'volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83db145e-d4ca-4fd1-a187-3db725d57b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83db145e-d4ca-4fd1-a187-3db725d57b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c0e028-0bb0-4f49-a0e5-23f8386ef193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:37 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Volume 307f5db8-e239-4db3-bc4e-be4c4a5611b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5', 'volume_size': 1} Aug 25 07:10:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:38 devstack sudo[114288]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 1073741824" returned: 0 in 0.776s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:38 devstack sudo[114295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 Aug 25 07:10:38 devstack sudo[114295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:38 devstack sudo[114295]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81" returned: 0 in 0.542s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-747321876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307f5db8-e239-4db3-bc4e-be4c4a5611b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94549488b8524ac382bf86047a38e36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:37Z,use_quota=True,user_id='6519d121f4ad43e9acb3d92139edc8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Creating volume 307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:38 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:38 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 1073741824 Aug 25 07:10:38 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed07556a-a354-44ca-a861-d7792f6bb886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9add703-3fc6-413a-a35a-8894dd6f1d81', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947e20de-bda6-4ff5-b46a-a56657cf9ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:38 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Volume volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 (c9add703-3fc6-413a-a35a-8894dd6f1d81): created successfully Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947e20de-bda6-4ff5-b46a-a56657cf9ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:38 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (4eb368ab-3180-4465-afa0-521db2cd0295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:38 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c7173c58-67b5-46f7-8cc5-1ab97b242e9c tempest-ProjectReaderTests-1687916709 None] Created volume successfully. Aug 25 07:10:39 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 1073741824" returned: 0 in 0.721s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:39 devstack sudo[114305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 Aug 25 07:10:39 devstack sudo[114305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:39 devstack sudo[114305]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.413s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Creating offline snapshot 00472010-db42-4732-b9f1-606af8831881 of volume c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c0e028-0bb0-4f49-a0e5-23f8386ef193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9a430c-8df2-4b4c-8fa9-0541d952f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cff21c-b1ff-4acd-a90c-c0ce2651eabc]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:39 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Volume volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 (307f5db8-e239-4db3-bc4e-be4c4a5611b5): created successfully Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9a430c-8df2-4b4c-8fa9-0541d952f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Flow 'volume_create_manager' (809217dc-6ca0-4f2e-93f0-b6ef38262eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (e6a12a2c-3a57-4057-9e99-2470c056e87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f01bc7-6c08-4cf5-a7e7-401b906296d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e21d96b2-6878-4f5a-b2d9-f44c114a2cfc tempest-CinderUnicodeTest-1822153084 None] Created volume successfully. Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f01bc7-6c08-4cf5-a7e7-401b906296d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182099845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558fc625-cd16-49f6-8687-0dfe2b222d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:40Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a852e1-c4e1-4977-bf45-9826fe8c3584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a852e1-c4e1-4977-bf45-9826fe8c3584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:39 devstack sudo[114308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 Aug 25 07:10:39 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d7498a-9628-4a5c-9013-bb6dd0c98f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d7498a-9628-4a5c-9013-bb6dd0c98f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558fc625-cd16-49f6-8687-0dfe2b222d02', 'volume_name': 'volume-558fc625-cd16-49f6-8687-0dfe2b222d02', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de93595b-0420-40c7-a91c-1c7c6284b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de93595b-0420-40c7-a91c-1c7c6284b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e685f1b-4356-4ab0-8fb8-545b7033de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume 558fc625-cd16-49f6-8687-0dfe2b222d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558fc625-cd16-49f6-8687-0dfe2b222d02', 'volume_size': 1} Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:40 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81" returned: 0 in 0.523s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:40 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 1G Aug 25 07:10:40 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:40 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 1G" returned: 0 in 0.598s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:40 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 Aug 25 07:10:40 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:41 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:41 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 is being set with open permissions: ugo+rw Aug 25 07:10:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:41 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 Aug 25 07:10:41 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:41 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881" returned: 0 in 0.299s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:41 devstack sudo[114328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info Aug 25 07:10:41 devstack sudo[114328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:42 devstack sudo[114328]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:42 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info is being set with open permissions: ugo+rw Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:42 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info Aug 25 07:10:42 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:42 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.info" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182099845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558fc625-cd16-49f6-8687-0dfe2b222d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:40Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating volume 558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:42 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:42 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 1073741824 Aug 25 07:10:42 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:42 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b5365b15-64f8-4ba4-95e5-ae359d00f2c1 tempest-ProjectReaderTests-1687916709 None] Create snapshot completed successfully Aug 25 07:10:42 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 1073741824" returned: 0 in 0.435s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:43 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 Aug 25 07:10:43 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:43 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02" returned: 0 in 0.250s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.385s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e685f1b-4356-4ab0-8fb8-545b7033de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558fc625-cd16-49f6-8687-0dfe2b222d02', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3d4df7-3ff3-4e5c-a20d-224761383718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Creating offline snapshot cabf3719-3d28-4c4a-a1db-58f317da190d of volume 307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663f87f-a63e-4166-a5ed-7e76a79cecc8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:43 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 Aug 25 07:10:43 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:43 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume volume-558fc625-cd16-49f6-8687-0dfe2b222d02 (558fc625-cd16-49f6-8687-0dfe2b222d02): created successfully Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3d4df7-3ff3-4e5c-a20d-224761383718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (e6a12a2c-3a57-4057-9e99-2470c056e87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:43 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bd8e166c-583c-41b7-a1fe-c879797fc040 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created volume successfully. Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-00472010-db42-4732-b9f1-606af8831881-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-00472010-db42-4732-b9f1-606af8831881-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-c9add703-3fc6-413a-a35a-8894dd6f1d81" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-c9add703-3fc6-413a-a35a-8894dd6f1d81" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-00472010-db42-4732-b9f1-606af8831881" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-00472010-db42-4732-b9f1-606af8831881" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Deleting offline snapshot 00472010-db42-4732-b9f1-606af8831881 of volume c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] snapshot_file for this snap is: volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3365edd-006f-48d5-a9ef-ee8d0215d18d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:43 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5" returned: 0 in 0.388s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:43 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d 1G Aug 25 07:10:43 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:43 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 Aug 25 07:10:43 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:44 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881" returned: 0 in 0.449s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9add703-3fc6-413a-a35a-8894dd6f1d81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab168d1-894c-4100-b2c7-5a3816d84956]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:44 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d 1G" returned: 0 in 0.479s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:44 devstack sudo[114359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d Aug 25 07:10:44 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:44 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 Aug 25 07:10:44 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:44 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d" returned: 0 in 0.303s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:44 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d is being set with open permissions: ugo+rw Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:44 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81" returned: 0 in 0.360s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:44 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d Aug 25 07:10:44 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:44 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 Aug 25 07:10:44 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:44 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=250,cinder:SELECT=179,cinder:DELETE=28,cinder:INSERT=79 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=184,cinder:INSERT=55,cinder:UPDATE=244,cinder:DELETE=18 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:10:44 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:44 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881 Aug 25 07:10:44 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:45 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81.00472010-db42-4732-b9f1-606af8831881" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-00472010-db42-4732-b9f1-606af8831881" released by "_delete_snapshot" :: held 1.487s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-c9add703-3fc6-413a-a35a-8894dd6f1d81" released by "delete_snapshot" :: held 1.512s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:47 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info Aug 25 07:10:47 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Created reservations ['4c7f3f9d-ac93-4ecb-96ad-b4b7c3625a0b', 'ed2259fb-269a-4f73-b33c-62610a524a70', '6ad5fd7e-d21e-4684-abe7-1e266f132609', '2f8c40fe-4272-4174-844b-28d849058f5b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Delete snapshot completed successfully. Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fb9e06ae-c3e1-407d-80cf-6e720d8e6014 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-00472010-db42-4732-b9f1-606af8831881-delete_snapshot" released by "delete_snapshot" :: held 3.993s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:47 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info" returned: 0 in 0.352s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:47 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info is being set with open permissions: ugo+rw Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:47 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info Aug 25 07:10:47 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-c9add703-3fc6-413a-a35a-8894dd6f1d81-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Lock "cinder-c9add703-3fc6-413a-a35a-8894dd6f1d81-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-c9add703-3fc6-413a-a35a-8894dd6f1d81" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-c9add703-3fc6-413a-a35a-8894dd6f1d81" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60289f8-7abb-49c1-a844-2565fc53ccd7]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:48 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.info" returned: 0 in 0.387s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.787s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:48 devstack sudo[114385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 Aug 25 07:10:48 devstack sudo[114385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating offline snapshot 473e4bfc-0f51-4c6e-8851-3d9001c03ef8 of volume 558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ff5795ef-2673-491e-93e8-53088acccfeb tempest-CinderUnicodeTest-1822153084 None] Create snapshot completed successfully Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6904fa-5d53-4ef5-bed2-cc990f2c7591]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-cabf3719-3d28-4c4a-a1db-58f317da190d-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-cabf3719-3d28-4c4a-a1db-58f317da190d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-quobyte-307f5db8-e239-4db3-bc4e-be4c4a5611b5" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-307f5db8-e239-4db3-bc4e-be4c4a5611b5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-quobyte-cabf3719-3d28-4c4a-a1db-58f317da190d" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:48 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 Aug 25 07:10:48 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-cabf3719-3d28-4c4a-a1db-58f317da190d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Deleting offline snapshot cabf3719-3d28-4c4a-a1db-58f317da190d of volume 307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] snapshot_file for this snap is: volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04d1e5-d004-4b52-bee5-22109a1ea82b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:48 devstack sudo[114385]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81" returned: 0 in 0.446s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:48 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81 Aug 25 07:10:48 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:48 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d Aug 25 07:10:48 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:48 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02" returned: 0 in 0.558s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:48 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 1G Aug 25 07:10:48 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:48 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9add703-3fc6-413a-a35a-8894dd6f1d81" returned: 0 in 0.377s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-c9add703-3fc6-413a-a35a-8894dd6f1d81" released by "delete_volume" :: held 0.911s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Created reservations ['f6ba4eab-7c77-48b9-af70-20839411928f', 'c4a0fb2a-7b6c-4dd3-8a5b-435358470abe', 'b19f8a53-5eae-41b8-b9c8-14f5dab2198c', '43514254-4b55-4a81-a265-e6bddd3ff202'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:48 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d" returned: 0 in 0.570s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda23e6d-7afc-45fe-a34e-ae71b7128b4c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:49 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:49 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:49 devstack sudo[114410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 Aug 25 07:10:49 devstack sudo[114410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:49 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 1G" returned: 0 in 0.736s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-558fc625-cd16-49f6-8687-0dfe2b222d02 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:49 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-558fc625-cd16-49f6-8687-0dfe2b222d02 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 Aug 25 07:10:49 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:49 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.504s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:49 devstack sudo[114410]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:49 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Deleted volume successfully. Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5" returned: 0 in 0.525s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-54eb6ea6-8f35-4fd4-a8ab-2d6d5d18c15f tempest-ProjectReaderTests-1687916709 None] Lock "cinder-c9add703-3fc6-413a-a35a-8894dd6f1d81-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:49 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d Aug 25 07:10:49 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:49 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-558fc625-cd16-49f6-8687-0dfe2b222d02 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:49 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 is being set with open permissions: ugo+rw Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:49 devstack sudo[114426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 Aug 25 07:10:49 devstack sudo[114426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (8573b804-b922-42cb-817c-308b8a5dca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d837d03e-99c5-433a-81a7-0d3c64875037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d837d03e-99c5-433a-81a7-0d3c64875037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816016074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:50Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01236bac-9f49-4a73-b8e0-c9b8b7ec8fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01236bac-9f49-4a73-b8e0-c9b8b7ec8fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5201581-5a5b-413b-9ec3-37e462093c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5201581-5a5b-413b-9ec3-37e462093c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705', 'volume_name': 'volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e9a641-6ac9-4f1a-a95f-ead5c48ef8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e9a641-6ac9-4f1a-a95f-ead5c48ef8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a95e514-d1b5-49f0-84b1-3a8d52cf69f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Volume 66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705', 'volume_size': 1} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:50 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d" returned: 0 in 0.487s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:50 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d Aug 25 07:10:50 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:50 devstack sudo[114426]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8" returned: 0 in 0.274s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:50 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info Aug 25 07:10:50 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:50 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5.cabf3719-3d28-4c4a-a1db-58f317da190d" returned: 0 in 0.286s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-cabf3719-3d28-4c4a-a1db-58f317da190d" released by "_delete_snapshot" :: held 2.046s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-307f5db8-e239-4db3-bc4e-be4c4a5611b5" released by "delete_snapshot" :: held 2.074s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:50 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info" returned: 0 in 0.288s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:50 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info is being set with open permissions: ugo+rw Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Created reservations ['cbd7e4be-147d-4b32-8e06-e2facd053aec', 'f9842435-091e-4d7f-8633-6008d267d7b1', '0d895869-c141-4411-8b26-28df5aa1f711', '6985815a-9d0c-44fb-b07a-538e03456a5d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:50 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info Aug 25 07:10:50 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Delete snapshot completed successfully. Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-5456b199-34b3-450a-8d71-ae6a5fbec0b9 tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-cabf3719-3d28-4c4a-a1db-58f317da190d-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:50 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.info" returned: 0 in 0.326s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816016074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:50Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Creating volume 66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:50 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:50 devstack sudo[114441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 1073741824 Aug 25 07:10:50 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-94274ab0-7b37-4b78-ad84-18aa8cee6f78 tempest-CreateVolumesFromSnapshotTest-918682167 None] Create snapshot completed successfully Aug 25 07:10:51 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 1073741824" returned: 0 in 0.471s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:51 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 Aug 25 07:10:51 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-307f5db8-e239-4db3-bc4e-be4c4a5611b5-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-307f5db8-e239-4db3-bc4e-be4c4a5611b5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-quobyte-307f5db8-e239-4db3-bc4e-be4c4a5611b5" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-307f5db8-e239-4db3-bc4e-be4c4a5611b5" acquired by "delete_volume" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:51 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4982bc65-92cb-42bb-8c95-5ad5bd7ad4a2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a95e514-d1b5-49f0-84b1-3a8d52cf69f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f765f9-9d77-496a-830b-dcf0297ff75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:51 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Volume volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 (66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705): created successfully Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f765f9-9d77-496a-830b-dcf0297ff75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:51 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (8573b804-b922-42cb-817c-308b8a5dca85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:51 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ff29356f-aea6-4704-bb08-b609f5d1038e tempest-ProjectReaderTests-1687916709 None] Created volume successfully. Aug 25 07:10:51 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 Aug 25 07:10:51 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:52 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5" returned: 0 in 0.665s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Creating offline snapshot 1b113184-9442-4eba-833b-af143ce3412e of volume 66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad592bd7-403c-4dff-80c4-e920d22898aa]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:52 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5 Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:52 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:52 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 Aug 25 07:10:52 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:52 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:52 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (008f410a-c407-47d7-b32e-682e2c56cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ec5ead-d57b-4a69-8a39-d62c29ccdb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-307f5db8-e239-4db3-bc4e-be4c4a5611b5" returned: 0 in 0.633s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" returned: 0 in 0.594s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ec5ead-d57b-4a69-8a39-d62c29ccdb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664973973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e41a24-b550-46cb-9a63-a77a9dd187b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:53Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e 1G Aug 25 07:10:53 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95661a7d-ef1e-4027-bdd5-e7dbf02be486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95661a7d-ef1e-4027-bdd5-e7dbf02be486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bbd75a-9ed7-4353-8574-46d238b7aade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bbd75a-9ed7-4353-8574-46d238b7aade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e41a24-b550-46cb-9a63-a77a9dd187b3', 'volume_name': 'volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7231e9-eb74-48ec-828e-589777f7f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7231e9-eb74-48ec-828e-589777f7f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1f64c8-ea89-4e3a-80a3-ca3e5e052fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume f6e41a24-b550-46cb-9a63-a77a9dd187b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3', 'volume_size': 1} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-307f5db8-e239-4db3-bc4e-be4c4a5611b5" released by "delete_volume" :: held 1.503s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Created reservations ['a85bff0b-ce3e-450c-a34f-1027e1000ced', '87b7ac75-5192-48e3-baff-4c939ea1adfb', '8c2144a8-c293-4d07-ad3d-3673af8bf204', 'fbc615c5-170c-433f-88b9-d414f77704be'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:53 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:53 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (e03a7167-c420-4bbc-98f5-42bbb7068494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abf395c-10b3-4930-a4d4-0c7e89ab39fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abf395c-10b3-4930-a4d4-0c7e89ab39fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905543742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb0a749-2a6a-47a1-a204-14243986dd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:53Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ebeba6-ced2-492c-9c90-e3630169d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ebeba6-ced2-492c-9c90-e3630169d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6840e450-ac4d-48e0-9603-8dc3f83a40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6840e450-ac4d-48e0-9603-8dc3f83a40f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb0a749-2a6a-47a1-a204-14243986dd07', 'volume_name': 'volume-cbb0a749-2a6a-47a1-a204-14243986dd07', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811914ff-3c66-4304-9e27-4e0bc89112e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811914ff-3c66-4304-9e27-4e0bc89112e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e140930-f402-47fd-9383-8869ae81d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:53 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume cbb0a749-2a6a-47a1-a204-14243986dd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb0a749-2a6a-47a1-a204-14243986dd07', 'volume_size': 1} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:53 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e 1G" returned: 0 in 0.703s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:53 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e Aug 25 07:10:53 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-a470684d-fe55-4516-a8b9-d7e7e65a701e-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:54 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.657s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:54 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Deleted volume successfully. Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (fc440f4a-3bd0-4968-bd6c-a268d60ab61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5887b1-1322-4fd3-8b0f-f35092793f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-a470684d-fe55-4516-a8b9-d7e7e65a701e-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5887b1-1322-4fd3-8b0f-f35092793f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140348575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:54Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:54 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6470b8f-7a09-41d8-9d1c-18381060d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6470b8f-7a09-41d8-9d1c-18381060d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb013bb-c0e3-46a0-9abe-2111987a36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb013bb-c0e3-46a0-9abe-2111987a36bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943', 'volume_name': 'volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a879e509-9bf0-4fcf-a8c4-222389256f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a879e509-9bf0-4fcf-a8c4-222389256f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b3ebbc-355f-4dd9-a17a-4f00ac074b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943', 'volume_size': 1} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-300620fc-a00f-44a9-918f-cd9f1740eb5d tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-307f5db8-e239-4db3-bc4e-be4c4a5611b5-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e" returned: 0 in 0.641s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:54 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e is being set with open permissions: ugo+rw Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:54 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e Aug 25 07:10:54 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "cinder-quobyte-a470684d-fe55-4516-a8b9-d7e7e65a701e" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-a470684d-fe55-4516-a8b9-d7e7e65a701e" acquired by "delete_volume" :: waited 0.048s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf79a0b-7f92-4b73-b310-644e37975c70]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:54 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e Aug 25 07:10:54 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:54 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (3e96bd42-cd2c-4002-aac4-17026adf583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac1246b-2e31-4092-8837-f7cad6ebbc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e" returned: 0 in 0.583s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac1246b-2e31-4092-8837-f7cad6ebbc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408770977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f862d5-ba0d-4904-938e-2c34ad37b83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:55Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63a5f36-819b-4c82-9f68-b45f2f9bc7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63a5f36-819b-4c82-9f68-b45f2f9bc7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f3ba25-f89d-4852-b537-ba70f9881d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:54 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f3ba25-f89d-4852-b537-ba70f9881d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f862d5-ba0d-4904-938e-2c34ad37b83f', 'volume_name': 'volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc20158-ade1-44fc-963f-b9e0bb3f15db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc20158-ade1-44fc-963f-b9e0bb3f15db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f10dc08-7e43-4897-b659-7b7d34f8ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume d7f862d5-ba0d-4904-938e-2c34ad37b83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f', 'volume_size': 1} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:55 devstack sudo[114489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info Aug 25 07:10:55 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:55 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e" returned: 0 in 0.628s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:55 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e Aug 25 07:10:55 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (ff7c61c8-58b7-4923-bcc4-0448308d5f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69b48e2-4e08-4e70-9367-b9db2ad2f9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69b48e2-4e08-4e70-9367-b9db2ad2f9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985907044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08840367-0dbc-47a3-96ae-d4aa24009ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:55Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedb8c7d-51ad-4562-b4ce-d00562508c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedb8c7d-51ad-4562-b4ce-d00562508c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840dc2b7-23c7-4ef1-ab3b-eefd686323a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840dc2b7-23c7-4ef1-ab3b-eefd686323a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08840367-0dbc-47a3-96ae-d4aa24009ae8', 'volume_name': 'volume-08840367-0dbc-47a3-96ae-d4aa24009ae8', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:55 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396a0e46-492a-4aee-801b-038f36707277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396a0e46-492a-4aee-801b-038f36707277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a799c5b-5897-43fa-a618-3f25f615fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:55 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume 08840367-0dbc-47a3-96ae-d4aa24009ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08840367-0dbc-47a3-96ae-d4aa24009ae8', 'volume_size': 1} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-a470684d-fe55-4516-a8b9-d7e7e65a701e" returned: 0 in 0.543s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info" returned: 0 in 0.616s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:55 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info is being set with open permissions: ugo+rw Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-quobyte-a470684d-fe55-4516-a8b9-d7e7e65a701e" released by "delete_volume" :: held 1.250s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:55 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info Aug 25 07:10:55 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Created reservations ['1d86e488-b312-41c7-8f6d-2193aa48b505', 'ce119211-b5cf-4ff4-bade-968dbba71e6a', '45e3b5e5-3b45-465c-ad4e-eec09986061e', '2dfaedf0-9d22-4182-bf7b-7668096e144c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:55 devstack sudo[114497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:10:55 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:56 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.info" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.838s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664973973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e41a24-b550-46cb-9a63-a77a9dd187b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:53Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating volume f6e41a24-b550-46cb-9a63-a77a9dd187b3 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:56 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:56 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 1073741824 Aug 25 07:10:56 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9adedca3-2cfa-40b1-836e-79787a243917 tempest-ProjectReaderTests-1687916709 None] Create snapshot completed successfully Aug 25 07:10:56 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:10:56 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Deleted volume successfully. Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-1412ef8e-0c61-422c-ad61-4ca9b4e6c92a tempest-CinderUnicodeTest-1822153084 None] Lock "cinder-a470684d-fe55-4516-a8b9-d7e7e65a701e-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-1b113184-9442-4eba-833b-af143ce3412e-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-1b113184-9442-4eba-833b-af143ce3412e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-1b113184-9442-4eba-833b-af143ce3412e" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-1b113184-9442-4eba-833b-af143ce3412e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Deleting offline snapshot 1b113184-9442-4eba-833b-af143ce3412e of volume 66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] snapshot_file for this snap is: volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[25804b1c-a559-4032-8b57-85f94eb1a427]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:56 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 1073741824" returned: 0 in 0.696s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:56 devstack sudo[114507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e Aug 25 07:10:56 devstack sudo[114507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:56 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 Aug 25 07:10:56 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:57 devstack sudo[114507]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e" returned: 0 in 0.539s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:10:57 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3" returned: 0 in 0.428s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.632s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905543742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb0a749-2a6a-47a1-a204-14243986dd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:53Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating volume cbb0a749-2a6a-47a1-a204-14243986dd07 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:57 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b1cb11-29b3-4dc8-a3ca-994b1d9e1bde]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:57 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 1073741824 Aug 25 07:10:57 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1f64c8-ea89-4e3a-80a3-ca3e5e052fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6730144a-fe82-43ae-9c22-581ae9703147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:57 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 (f6e41a24-b550-46cb-9a63-a77a9dd187b3): created successfully Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6730144a-fe82-43ae-9c22-581ae9703147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (008f410a-c407-47d7-b32e-682e2c56cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-17e0b49d-288b-4fad-8db7-1af8be987ec8 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created volume successfully. Aug 25 07:10:57 devstack sudo[114516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 Aug 25 07:10:57 devstack sudo[114516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:57 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 1073741824" returned: 0 in 0.664s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:57 devstack sudo[114516]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" returned: 0 in 0.664s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:58 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e Aug 25 07:10:58 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:58 devstack sudo[114527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 Aug 25 07:10:58 devstack sudo[114527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:58 devstack sudo[114527]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07" returned: 0 in 0.424s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:58 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.141s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140348575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:54Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating volume e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:58 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e" returned: 0 in 0.526s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:58 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 1073741824 Aug 25 07:10:58 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e140930-f402-47fd-9383-8869ae81d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb0a749-2a6a-47a1-a204-14243986dd07', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e385fd7-d5ea-495f-96dd-b934a86094f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:58 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e Aug 25 07:10:58 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:58 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume volume-cbb0a749-2a6a-47a1-a204-14243986dd07 (cbb0a749-2a6a-47a1-a204-14243986dd07): created successfully Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e385fd7-d5ea-495f-96dd-b934a86094f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (e03a7167-c420-4bbc-98f5-42bbb7068494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-789492c8-f764-487c-a5f2-cc0e9f003725 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created volume successfully. Aug 25 07:10:58 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705.1b113184-9442-4eba-833b-af143ce3412e" returned: 0 in 0.462s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-1b113184-9442-4eba-833b-af143ce3412e" released by "_delete_snapshot" :: held 2.349s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" released by "delete_snapshot" :: held 2.387s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Created reservations ['66ec7907-2731-4d84-9305-d25ad562597a', 'cf13378b-ad5f-4f30-8965-139d8e665310', 'a435aa31-1fba-4169-93c6-0fad7b0029a1', 'd9184ad1-86d3-4ce1-aa47-2dc8e2e32bb6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:10:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Delete snapshot completed successfully. Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2e8da0eb-fd4a-44b4-8dfa-336ab9e60559 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-1b113184-9442-4eba-833b-af143ce3412e-delete_snapshot" released by "delete_snapshot" :: held 2.693s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:10:59 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 1073741824" returned: 0 in 0.904s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:10:59 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 Aug 25 07:10:59 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Flow 'volume_create_manager' (891c8a06-add8-4016-9646-e52748d82bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a2065f-e53e-429c-aa7e-cd0d48a4dc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a2065f-e53e-429c-aa7e-cd0d48a4dc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-437239930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa34341-de13-4bc4-8269-d73809d2f9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47efc01458434ffc80add336704c8a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:59Z,use_quota=True,user_id='bfe7c8931a3d4dbeb627f7103a8416c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493ae81e-0d32-4cb3-b017-82599189ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493ae81e-0d32-4cb3-b017-82599189ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff87822-ee92-4a0f-ab26-dbbaaaa792fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff87822-ee92-4a0f-ab26-dbbaaaa792fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa34341-de13-4bc4-8269-d73809d2f9ed', 'volume_name': 'volume-7fa34341-de13-4bc4-8269-d73809d2f9ed', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a18e81d-de95-478d-9e48-17a2558c394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a18e81d-de95-478d-9e48-17a2558c394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb91304-55d6-4784-9398-08570fd83c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:59 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Volume 7fa34341-de13-4bc4-8269-d73809d2f9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa34341-de13-4bc4-8269-d73809d2f9ed', 'volume_size': 1} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:59 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943" returned: 0 in 0.295s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.733s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408770977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f862d5-ba0d-4904-938e-2c34ad37b83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:55Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating volume d7f862d5-ba0d-4904-938e-2c34ad37b83f {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:10:59 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b3ebbc-355f-4dd9-a17a-4f00ac074b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:59 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f 1073741824 Aug 25 07:10:59 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31aa5e2-24c1-4551-b153-52df891f2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:10:59 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 (e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943): created successfully Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31aa5e2-24c1-4551-b153-52df891f2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (fc440f4a-3bd0-4968-bd6c-a268d60ab61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:10:59 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-789aa486-a949-4427-bc9e-5d0dbd673e1c tempest-CreateVolumesFromSnapshotTest-918682167 None] Created volume successfully. Aug 25 07:10:59 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9665e6-8fc7-4757-b595-50a44c2f7d51]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:00 devstack sudo[114549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 Aug 25 07:11:00 devstack sudo[114549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:00 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f 1073741824" returned: 0 in 0.598s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:00 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f Aug 25 07:11:00 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:00 devstack sudo[114549]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:00 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705 Aug 25 07:11:00 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:00 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f" returned: 0 in 0.316s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.071s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985907044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08840367-0dbc-47a3-96ae-d4aa24009ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50757d7d815a4bdd9069721ce20c1628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:55Z,use_quota=True,user_id='e7e1c7b038564ccda13274e7f5cd931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Creating volume 08840367-0dbc-47a3-96ae-d4aa24009ae8 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:00 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:00 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 1073741824 Aug 25 07:11:00 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f10dc08-7e43-4897-b659-7b7d34f8ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24125bae-8d7e-44e1-a361-6ea3ea92b265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:00 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f (d7f862d5-ba0d-4904-938e-2c34ad37b83f): created successfully Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24125bae-8d7e-44e1-a361-6ea3ea92b265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (3e96bd42-cd2c-4002-aac4-17026adf583b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-88e9143e-6c00-4066-8b4c-017c9ed4d539 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created volume successfully. Aug 25 07:11:00 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" returned: 0 in 0.409s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705" released by "delete_volume" :: held 0.919s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Created reservations ['93d12102-b7ac-4bc5-b6ef-117e6b28eccd', '0bf7c219-75fe-427c-a260-92a5c1d617ca', '6d9d9baa-b7de-4830-b738-73da6c9a73ff', '6448e39a-555c-4888-ba2f-05c3554d6899'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:01 devstack sudo[114568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:01 devstack sudo[114568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:01 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 1073741824" returned: 0 in 0.580s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:01 devstack sudo[114568]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.303s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Deleted volume successfully. Aug 25 07:11:01 devstack sudo[114572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 Aug 25 07:11:01 devstack sudo[114572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-a571b43a-6b14-4f12-a807-093e36d71290 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-66cc3f72-9d0e-42fe-8bb9-b41a2c0cb705-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:01 devstack sudo[114572]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.064s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-437239930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa34341-de13-4bc4-8269-d73809d2f9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47efc01458434ffc80add336704c8a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:10:59Z,use_quota=True,user_id='bfe7c8931a3d4dbeb627f7103a8416c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Creating volume 7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:01 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:01 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed 1073741824 Aug 25 07:11:01 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a799c5b-5897-43fa-a618-3f25f615fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08840367-0dbc-47a3-96ae-d4aa24009ae8', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f461209-9581-4a80-8989-162dd304828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:01 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Volume volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 (08840367-0dbc-47a3-96ae-d4aa24009ae8): created successfully Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f461209-9581-4a80-8989-162dd304828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:01 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Flow 'volume_create_manager' (ff7c61c8-58b7-4923-bcc4-0448308d5f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:01 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-cb34a408-1168-4614-8d51-a3448bf109c1 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created volume successfully. Aug 25 07:11:02 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed 1073741824" returned: 0 in 0.496s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:02 devstack sudo[114581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed Aug 25 07:11:02 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (0e0632d8-6f0b-4338-ad47-26c8b4a0759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc71cb2-c576-400e-b143-c5fc97fe445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc71cb2-c576-400e-b143-c5fc97fe445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698732593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e65091-2dd4-468d-b482-bafbf707850d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:02Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dc3bfa-f942-4bdc-9270-d3664eb0e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dc3bfa-f942-4bdc-9270-d3664eb0e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828fa4f-993c-4563-9505-68ef23e1739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828fa4f-993c-4563-9505-68ef23e1739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e65091-2dd4-468d-b482-bafbf707850d', 'volume_name': 'volume-c9e65091-2dd4-468d-b482-bafbf707850d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1604bfe9-9230-4c5d-95c6-f7b7e8e6385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1604bfe9-9230-4c5d-95c6-f7b7e8e6385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2289099-fe04-474e-b1c3-83a893cd60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Volume c9e65091-2dd4-468d-b482-bafbf707850d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e65091-2dd4-468d-b482-bafbf707850d', 'volume_size': 1} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-08840367-0dbc-47a3-96ae-d4aa24009ae8-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-08840367-0dbc-47a3-96ae-d4aa24009ae8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-08840367-0dbc-47a3-96ae-d4aa24009ae8" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-08840367-0dbc-47a3-96ae-d4aa24009ae8" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300483b-8658-4e77-a2ed-6555c982bf0d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:02 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed" returned: 0 in 0.309s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.184s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698732593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e65091-2dd4-468d-b482-bafbf707850d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:02Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Creating volume c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:02 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb91304-55d6-4784-9398-08570fd83c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa34341-de13-4bc4-8269-d73809d2f9ed', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d 1073741824 Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764bb3a6-f19c-4331-b552-bb2e417e97ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:02 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 Aug 25 07:11:02 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Volume volume-7fa34341-de13-4bc4-8269-d73809d2f9ed (7fa34341-de13-4bc4-8269-d73809d2f9ed): created successfully Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764bb3a6-f19c-4331-b552-bb2e417e97ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Flow 'volume_create_manager' (891c8a06-add8-4016-9646-e52748d82bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6ade9896-069c-45ef-98bb-e439e71c8005 tempest-SnapshotDependencyTests-1667282926 None] Created volume successfully. Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (d26f16b7-5761-4ddf-993f-a4bbf7165de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee589f-e745-42f1-92a3-cc8eeb9ce76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee589f-e745-42f1-92a3-cc8eeb9ce76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693022444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc97ebd-899c-445e-a460-364efc0b46b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:03Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4611fcd-a2c9-4fc4-88f1-db07e0a9ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4611fcd-a2c9-4fc4-88f1-db07e0a9ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e89a39-cc4f-48c4-9ad9-0e7ddf7fd73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e89a39-cc4f-48c4-9ad9-0e7ddf7fd73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc97ebd-899c-445e-a460-364efc0b46b4', 'volume_name': 'volume-efc97ebd-899c-445e-a460-364efc0b46b4', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f197da-02e8-45c8-bd5a-6d919174b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f197da-02e8-45c8-bd5a-6d919174b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6078f1b5-0fda-48f8-8e65-a4a162a816bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:02 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Volume efc97ebd-899c-445e-a460-364efc0b46b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc97ebd-899c-445e-a460-364efc0b46b4', 'volume_size': 1} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:02 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8" returned: 0 in 0.447s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:02 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8 Aug 25 07:11:02 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:03 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d 1073741824" returned: 0 in 0.553s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:03 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d Aug 25 07:11:03 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:03 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-08840367-0dbc-47a3-96ae-d4aa24009ae8" returned: 0 in 0.303s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-08840367-0dbc-47a3-96ae-d4aa24009ae8" released by "delete_volume" :: held 0.804s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['22207874-2ecb-481b-8860-0994589f148b', 'b6774992-52d4-4820-98fe-0145bc086a9f', 'b22c0eeb-77f5-43f1-a7a8-93969784e072', 'cd0e3537-6ea1-42b0-99d9-a0e40bcb149a'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:03 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:03 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:03 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d" returned: 0 in 0.316s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693022444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc97ebd-899c-445e-a460-364efc0b46b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfbc85a20da4579bbeb91bac28c0eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:03Z,use_quota=True,user_id='1121f9a4ccb34acaa409518d32a092d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Creating volume efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:03 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2289099-fe04-474e-b1c3-83a893cd60fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e65091-2dd4-468d-b482-bafbf707850d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:03 devstack sudo[114603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 1073741824 Aug 25 07:11:03 devstack sudo[114603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e18a84-75ef-4c6e-8042-098e66477354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-d7f862d5-ba0d-4904-938e-2c34ad37b83f-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:03 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Volume volume-c9e65091-2dd4-468d-b482-bafbf707850d (c9e65091-2dd4-468d-b482-bafbf707850d): created successfully Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e18a84-75ef-4c6e-8042-098e66477354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (0e0632d8-6f0b-4338-ad47-26c8b4a0759e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-d7f862d5-ba0d-4904-938e-2c34ad37b83f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6eb82eeb-229e-4a4d-b65f-d923c602d8c5 tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-d7f862d5-ba0d-4904-938e-2c34ad37b83f" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-d7f862d5-ba0d-4904-938e-2c34ad37b83f" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:03 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[695db600-bf0d-47a9-bbd7-349f01e660ed]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.347s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:03 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleted volume successfully. Aug 25 07:11:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-998f2b47-19c4-4f87-91f1-aff9fac5a208 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-08840367-0dbc-47a3-96ae-d4aa24009ae8-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:03 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f Aug 25 07:11:03 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:04 devstack sudo[114603]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 1073741824" returned: 0 in 0.516s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:04 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 Aug 25 07:11:04 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:04 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f" returned: 0 in 0.440s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:04 devstack sudo[114616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f Aug 25 07:11:04 devstack sudo[114616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:04 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4" returned: 0 in 0.290s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.034s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Creating offline snapshot 1f15fcc8-aae6-476b-8212-9ca81f73f109 of volume 7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6078f1b5-0fda-48f8-8e65-a4a162a816bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc97ebd-899c-445e-a460-364efc0b46b4', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094fc9d7-8fdf-4f81-989f-b6f243f4e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778851f-bd73-4517-b668-f79cac08698b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Volume volume-efc97ebd-899c-445e-a460-364efc0b46b4 (efc97ebd-899c-445e-a460-364efc0b46b4): created successfully Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094fc9d7-8fdf-4f81-989f-b6f243f4e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Flow 'volume_create_manager' (d26f16b7-5761-4ddf-993f-a4bbf7165de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b2c6d0ca-828c-4f64-a366-aa6c6e528e21 tempest-ProjectReaderTests-1687916709 None] Created volume successfully. Aug 25 07:11:04 devstack sudo[114616]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d7f862d5-ba0d-4904-938e-2c34ad37b83f" returned: 0 in 0.312s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-d7f862d5-ba0d-4904-938e-2c34ad37b83f" released by "delete_volume" :: held 0.806s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:04 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed Aug 25 07:11:04 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['83416842-1441-4106-9d8e-d39df992b446', '3ed3a8e5-2b70-498a-b5b7-e92735f8c08d', 'b43be458-fa64-4e95-bf62-c1448b882162', '1364ced4-4bb0-4000-8f46-be02318d8a16'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:04 devstack sudo[114622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:04 devstack sudo[114622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:04 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed" returned: 0 in 0.564s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2648c81-afa5-4875-a72f-d6b4f3564fa6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:04 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 1G Aug 25 07:11:04 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:05 devstack sudo[114622]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.401s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleted volume successfully. Aug 25 07:11:05 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 Aug 25 07:11:05 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3b3154cd-375b-46a6-8d17-760bf92d294e tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-d7f862d5-ba0d-4904-938e-2c34ad37b83f-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:05 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943" returned: 0 in 0.431s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:05 devstack sudo[114639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943 Aug 25 07:11:05 devstack sudo[114639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:05 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 1G" returned: 0 in 0.509s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa34341-de13-4bc4-8269-d73809d2f9ed -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:05 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa34341-de13-4bc4-8269-d73809d2f9ed -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 Aug 25 07:11:05 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:05 devstack sudo[114639]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943" returned: 0 in 0.274s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943" released by "delete_volume" :: held 0.762s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['ccb8becd-4309-4df8-afe2-b99500413db9', '0aeeea6d-ccbf-490c-962c-dd5743b339db', 'f3285dee-e76a-4f44-a8f1-3bc03d625f12', '3c9781f0-6415-4b90-b836-5ea374b2d3b6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:05 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa34341-de13-4bc4-8269-d73809d2f9ed -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109" returned: 0 in 0.342s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:05 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 is being set with open permissions: ugo+rw Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:05 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 Aug 25 07:11:05 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:05 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:05 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-cbb0a749-2a6a-47a1-a204-14243986dd07-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-cbb0a749-2a6a-47a1-a204-14243986dd07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:06 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-cbb0a749-2a6a-47a1-a204-14243986dd07" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109" returned: 0 in 0.307s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:06 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-cbb0a749-2a6a-47a1-a204-14243986dd07" acquired by "delete_volume" :: waited 0.030s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.297s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9609d470-1394-4372-a26a-2208c9fed21c]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleted volume successfully. Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-79afa2d2-863a-425c-b199-2fb2385f0fe0 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-e3a65496-c5cc-40a8-ae3c-8cfb9e3ee943-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:06 devstack sudo[114655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info Aug 25 07:11:06 devstack sudo[114655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:06 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 Aug 25 07:11:06 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:06 devstack sudo[114655]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info" returned: 0 in 0.289s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:06 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info is being set with open permissions: ugo+rw Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:06 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info Aug 25 07:11:06 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:06 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07" returned: 0 in 0.385s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:06 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07 Aug 25 07:11:06 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:06 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.info" returned: 0 in 0.286s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.027s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot bde3268f-5f8b-44f9-8850-0441cf3d6d13 of volume c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cadac0e-30b3-4380-9fd0-75f4c3de5d72]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:06 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:06 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a8ddf665-d8bd-4752-bf6a-e615ef034394 tempest-SnapshotDependencyTests-1667282926 None] Create snapshot completed successfully Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cbb0a749-2a6a-47a1-a204-14243986dd07" returned: 0 in 0.348s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-cbb0a749-2a6a-47a1-a204-14243986dd07" released by "delete_volume" :: held 0.787s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:06 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['6fbdb4f3-42a1-4540-8a4c-54f492f4389e', 'ed9c3a28-cd6d-4fb0-853e-3d7b3daff924', 'b8f65849-d3cd-41e7-baaa-65718f0cf490', '83b8628a-173c-48aa-a267-5267fb2a4d66'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:07 devstack sudo[114668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d Aug 25 07:11:07 devstack sudo[114668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:07 devstack sudo[114670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:07 devstack sudo[114670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-f6e41a24-b550-46cb-9a63-a77a9dd187b3-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-f6e41a24-b550-46cb-9a63-a77a9dd187b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:07 devstack sudo[114668]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d" returned: 0 in 0.431s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-f6e41a24-b550-46cb-9a63-a77a9dd187b3" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:07 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 1G Aug 25 07:11:07 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-f6e41a24-b550-46cb-9a63-a77a9dd187b3" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:07 devstack sudo[114670]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.323s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:07 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleted volume successfully. Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde4aa2-0ba7-4cc7-abab-35230dcfb356]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ebb72f35-e038-4b13-80c9-13e6808aa00d tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-cbb0a749-2a6a-47a1-a204-14243986dd07-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:07 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 Aug 25 07:11:07 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:07 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 1G" returned: 0 in 0.444s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9e65091-2dd4-468d-b482-bafbf707850d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:07 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9e65091-2dd4-468d-b482-bafbf707850d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 Aug 25 07:11:07 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:07 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3" returned: 0 in 0.433s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:07 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3 Aug 25 07:11:07 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:08 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-f6e41a24-b550-46cb-9a63-a77a9dd187b3" returned: 0 in 0.272s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-f6e41a24-b550-46cb-9a63-a77a9dd187b3" released by "delete_volume" :: held 0.769s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:08 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9e65091-2dd4-468d-b482-bafbf707850d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13" returned: 0 in 0.446s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:08 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 is being set with open permissions: ugo+rw Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['d485fb89-cb69-4d4e-ab04-684ea5abb3bf', '3dfca04f-1a0a-41d3-9766-a3808162202e', '68f8a230-1556-418f-b10b-33788e953fd7', 'c60fec36-85db-4b2f-b59c-fc225c788a92'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:08 devstack sudo[114694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 Aug 25 07:11:08 devstack sudo[114694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Flow 'volume_create_manager' (af53ca02-7efd-4e10-b306-7fe4be527b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558a9318-1da1-4005-862f-d979d7cb329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558a9318-1da1-4005-862f-d979d7cb329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbc677a-a011-43a6-9861-ab994e77c285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47efc01458434ffc80add336704c8a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f15fcc8-aae6-476b-8212-9ca81f73f109,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:08Z,use_quota=True,user_id='bfe7c8931a3d4dbeb627f7103a8416c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204005f4-4b78-4eef-8c99-a70a2d283517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204005f4-4b78-4eef-8c99-a70a2d283517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d0c4cd-348c-466c-b541-e03ce3d95280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d0c4cd-348c-466c-b541-e03ce3d95280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfbc677a-a011-43a6-9861-ab994e77c285', 'volume_name': 'volume-dfbc677a-a011-43a6-9861-ab994e77c285', 'volume_size': 1, 'snapshot_id': '1f15fcc8-aae6-476b-8212-9ca81f73f109'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3627eaf4-b36b-4bb4-b2ca-dcd860f2e089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3627eaf4-b36b-4bb4-b2ca-dcd860f2e089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245f75ca-929e-4237-99f3-fb9b4fff4d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:08 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Volume dfbc677a-a011-43a6-9861-ab994e77c285: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfbc677a-a011-43a6-9861-ab994e77c285', 'volume_size': 1, 'snapshot_id': '1f15fcc8-aae6-476b-8212-9ca81f73f109'} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:08 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:08 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-473e4bfc-0f51-4c6e-8851-3d9001c03ef8-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-473e4bfc-0f51-4c6e-8851-3d9001c03ef8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-558fc625-cd16-49f6-8687-0dfe2b222d02" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-558fc625-cd16-49f6-8687-0dfe2b222d02" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-473e4bfc-0f51-4c6e-8851-3d9001c03ef8" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-473e4bfc-0f51-4c6e-8851-3d9001c03ef8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleting offline snapshot 473e4bfc-0f51-4c6e-8851-3d9001c03ef8 of volume 558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:08 devstack sudo[114694]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] snapshot_file for this snap is: volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3012b8-95e5-4dce-bd18-cff5b78325d1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:08 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info Aug 25 07:11:08 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:08 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 Aug 25 07:11:08 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:08 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.314s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:08 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleted volume successfully. Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-2dad5670-c175-427c-ade0-a36840fadd34 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-f6e41a24-b550-46cb-9a63-a77a9dd187b3-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:08 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info" returned: 0 in 0.306s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:08 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info is being set with open permissions: ugo+rw Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:08 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info Aug 25 07:11:08 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:08 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8" returned: 0 in 0.422s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-558fc625-cd16-49f6-8687-0dfe2b222d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878bd3b-6972-46fd-a6d3-467cbb32c7f2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:09 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 Aug 25 07:11:09 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:09 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.info" returned: 0 in 0.283s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Creating offline snapshot dfdc2a1c-2a1d-416e-9ea8-30867132435b of volume efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-a187af25-3456-4e91-8355-d1e269163f93 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad49ab-2905-4ee8-a363-d20423411d79]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:09 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 Aug 25 07:11:09 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:09 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02" returned: 0 in 0.404s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:09 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 Aug 25 07:11:09 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:09 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4" returned: 0 in 0.408s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:09 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b 1G Aug 25 07:11:09 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:09 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:09 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8 Aug 25 07:11:09 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-bde3268f-5f8b-44f9-8850-0441cf3d6d13-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:10 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-bde3268f-5f8b-44f9-8850-0441cf3d6d13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:10 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-c9e65091-2dd4-468d-b482-bafbf707850d" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b 1G" returned: 0 in 0.444s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc97ebd-899c-445e-a460-364efc0b46b4 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02.473e4bfc-0f51-4c6e-8851-3d9001c03ef8" returned: 0 in 0.305s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-c9e65091-2dd4-468d-b482-bafbf707850d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-bde3268f-5f8b-44f9-8850-0441cf3d6d13" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:10 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc97ebd-899c-445e-a460-364efc0b46b4 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b Aug 25 07:11:10 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-bde3268f-5f8b-44f9-8850-0441cf3d6d13" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot bde3268f-5f8b-44f9-8850-0441cf3d6d13 of volume c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-473e4bfc-0f51-4c6e-8851-3d9001c03ef8" released by "_delete_snapshot" :: held 1.699s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-558fc625-cd16-49f6-8687-0dfe2b222d02" released by "delete_snapshot" :: held 1.724s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3788d3f-cb0c-4917-9da4-d5d875af5773]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['f98385ff-13fe-4fdd-a405-1cc1c3fa76a4', '460540aa-9d3d-4261-b2f9-1c6ffb123b9d', '1a41fbff-c3b5-4431-b1d3-2ff1b5b20e1d', 'b6bec515-b381-4971-82a2-e7ac986b5db3'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:10 devstack sudo[114738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 Aug 25 07:11:10 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:10 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Delete snapshot completed successfully. Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-3753b298-9887-4f9e-a0db-a50b45008d22 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-473e4bfc-0f51-4c6e-8851-3d9001c03ef8-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:10 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc97ebd-899c-445e-a460-364efc0b46b4 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:10 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b is being set with open permissions: ugo+rw Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:10 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b Aug 25 07:11:10 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-558fc625-cd16-49f6-8687-0dfe2b222d02-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:10 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9e65091-2dd4-468d-b482-bafbf707850d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cc2628-0d8d-4982-b9d3-d5b38c4a0dc8]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:10 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-558fc625-cd16-49f6-8687-0dfe2b222d02-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b" returned: 0 in 0.321s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "cinder-quobyte-558fc625-cd16-49f6-8687-0dfe2b222d02" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:10 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info Aug 25 07:11:10 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-558fc625-cd16-49f6-8687-0dfe2b222d02" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e6aa3-e907-40af-acf0-0f3e9d7ee99f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:10 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d Aug 25 07:11:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:10 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:10 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 Aug 25 07:11:10 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info is being set with open permissions: ugo+rw Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:11 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info Aug 25 07:11:11 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d" returned: 0 in 0.470s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:11 devstack sudo[114762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 Aug 25 07:11:11 devstack sudo[114762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02" returned: 0 in 0.441s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:11 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02 Aug 25 07:11:11 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.info" returned: 0 in 0.319s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.079s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-quobyte-1f15fcc8-aae6-476b-8212-9ca81f73f109-dfbc677a-a011-43a6-9861-ab994e77c285" by "_create_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-1f15fcc8-aae6-476b-8212-9ca81f73f109-dfbc677a-a011-43a6-9861-ab994e77c285" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Creating volume dfbc677a-a011-43a6-9861-ab994e77c285 from snapshot 1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-quobyte-dfbc677a-a011-43a6-9861-ab994e77c285" by "_copy_volume_from_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-675a6736-c6cb-4058-a54d-74fd7b174184 tempest-ProjectReaderTests-1687916709 None] Create snapshot completed successfully Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-dfbc677a-a011-43a6-9861-ab994e77c285" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] snapshot: 1f15fcc8-aae6-476b-8212-9ca81f73f109, volume: dfbc677a-a011-43a6-9861-ab994e77c285, {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade72384-947f-4445-ab15-87ea5d6d109a]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:11 devstack sudo[114762]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13" returned: 0 in 0.457s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:11 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-558fc625-cd16-49f6-8687-0dfe2b222d02" returned: 0 in 0.348s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13 Aug 25 07:11:11 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-quobyte-558fc625-cd16-49f6-8687-0dfe2b222d02" released by "delete_volume" :: held 0.853s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:11 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 Aug 25 07:11:11 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Created reservations ['d625f9fe-d7be-429f-a854-263a8221b2a9', '06d8a41d-6623-44d7-8220-a0578e6a9421', 'ae3c887d-fb64-4b34-9ad0-00bfc9973d32', 'fcfaece3-2cf8-4d37-a2a7-edc990a6f7dc'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:11 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:11 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:11 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d.bde3268f-5f8b-44f9-8850-0441cf3d6d13" returned: 0 in 0.315s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:11 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fa34341-de13-4bc4-8269-d73809d2f9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-bde3268f-5f8b-44f9-8850-0441cf3d6d13" released by "_delete_snapshot" :: held 1.835s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-c9e65091-2dd4-468d-b482-bafbf707850d" released by "delete_snapshot" :: held 1.893s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0aefb6-7fe7-4e51-b7cb-fdf3cf40671e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Created reservations ['55e4f133-fa02-4bf3-ad16-f10fcc59dc0f', '0f75fcc0-489d-45b7-a613-b2ba37d21dfe', '086d00dd-1d14-4ccf-a469-0094fb2029af', '00437be7-741d-464f-880e-81f87b9f44d1'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:12 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.289s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:12 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed Aug 25 07:11:12 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Deleted volume successfully. Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-0b31ca88-e02d-4340-a716-25fece1bc1c4 tempest-CreateVolumesFromSnapshotTest-918682167 None] Lock "cinder-558fc625-cd16-49f6-8687-0dfe2b222d02-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b16345ab-6576-432d-9147-ed0fd76505b0 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-bde3268f-5f8b-44f9-8850-0441cf3d6d13-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-c9e65091-2dd4-468d-b482-bafbf707850d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-c9e65091-2dd4-468d-b482-bafbf707850d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-c9e65091-2dd4-468d-b482-bafbf707850d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-c9e65091-2dd4-468d-b482-bafbf707850d" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01221a9-89d3-4b54-a614-444e3fce894b]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:12 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed" returned: 0 in 0.425s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Creating direct copy from snapshot {{(pid=94460) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.utils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Path /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 not found in is_blk_device check {{(pid=94460) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:12 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 Aug 25 07:11:12 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-dfdc2a1c-2a1d-416e-9ea8-30867132435b-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:12 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d Aug 25 07:11:12 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-dfdc2a1c-2a1d-416e-9ea8-30867132435b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-efc97ebd-899c-445e-a460-364efc0b46b4" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-efc97ebd-899c-445e-a460-364efc0b46b4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-dfdc2a1c-2a1d-416e-9ea8-30867132435b" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-dfdc2a1c-2a1d-416e-9ea8-30867132435b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Deleting offline snapshot dfdc2a1c-2a1d-416e-9ea8-30867132435b of volume efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] snapshot_file for this snap is: volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd87cc98-b1d5-4e83-b7c8-75e279f7922e]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:12 devstack sudo[114793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b Aug 25 07:11:12 devstack sudo[114793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:12 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d" returned: 0 in 0.448s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:12 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d Aug 25 07:11:12 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:13 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-c9e65091-2dd4-468d-b482-bafbf707850d" returned: 0 in 0.406s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-c9e65091-2dd4-468d-b482-bafbf707850d" released by "delete_volume" :: held 0.952s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:13 devstack sudo[114793]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b" returned: 0 in 0.653s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efc97ebd-899c-445e-a460-364efc0b46b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa1468e-0063-47ca-a3b7-7ffe385c097d]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:13 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Created reservations ['aa41d60a-e600-4aba-9d3e-a037dace0e90', 'd4640519-4bfe-4231-81d3-c83c2bfa08af', 'ce090776-f97c-47f5-ab9e-924cc32716d9', '09d97c27-15e8-40fa-80d2-1b651976bc72'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:13 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 Aug 25 07:11:13 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:14 devstack sudo[114817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:14 devstack sudo[114817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:14 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4" returned: 0 in 1.212s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:14 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b Aug 25 07:11:14 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:14 devstack sudo[114817]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.856s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:14 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:14 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:11:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9c42e6cf-ab10-4868-8542-d6634ed58a2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-c9e65091-2dd4-468d-b482-bafbf707850d-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:15 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b" returned: 0 in 0.895s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:15 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b Aug 25 07:11:15 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (5038175a-c23e-4786-9c2c-7172c021eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd259fec-1b60-4526-8905-89b206f6e7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:16 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4.dfdc2a1c-2a1d-416e-9ea8-30867132435b" returned: 0 in 0.844s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd259fec-1b60-4526-8905-89b206f6e7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871702216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9276b0df-c75e-461d-94c6-86ea24b0ff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:16Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525e34bd-9e2e-45c4-b163-04ad2a26bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525e34bd-9e2e-45c4-b163-04ad2a26bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bef818c-e2a6-42ce-bc56-4e1f56716f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bef818c-e2a6-42ce-bc56-4e1f56716f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9276b0df-c75e-461d-94c6-86ea24b0ff66', 'volume_name': 'volume-9276b0df-c75e-461d-94c6-86ea24b0ff66', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f5b00d-cedb-42d3-a936-b062e67c04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f5b00d-cedb-42d3-a936-b062e67c04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb5742d-3c84-4b88-ab34-d2f735c18272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:16 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Volume 9276b0df-c75e-461d-94c6-86ea24b0ff66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9276b0df-c75e-461d-94c6-86ea24b0ff66', 'volume_size': 1} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-dfdc2a1c-2a1d-416e-9ea8-30867132435b" released by "_delete_snapshot" :: held 4.016s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-efc97ebd-899c-445e-a460-364efc0b46b4" released by "delete_snapshot" :: held 4.065s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:16 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Created reservations ['a4cca2a4-3584-41b0-b087-fb96d85d51db', 'd80ee581-d330-45cd-ad1d-d91b465f2468', '55802ab3-9de3-4cb3-b4aa-8ba3d33e5499', '1e4d1230-4e90-455e-8848-a6f42c66d04f'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:17 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Delete snapshot completed successfully. Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-be48ae28-20d9-4575-affa-cc6f5eaf6ac2 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-dfdc2a1c-2a1d-416e-9ea8-30867132435b-delete_snapshot" released by "delete_snapshot" :: held 4.544s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-efc97ebd-899c-445e-a460-364efc0b46b4-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-efc97ebd-899c-445e-a460-364efc0b46b4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "cinder-quobyte-efc97ebd-899c-445e-a460-364efc0b46b4" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-efc97ebd-899c-445e-a460-364efc0b46b4" acquired by "delete_volume" :: waited 0.034s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a64e91-347e-49a8-8769-55c244db89ee]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:17 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 Aug 25 07:11:17 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:18 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4" returned: 0 in 0.918s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:18 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285" returned: 0 in 6.053s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.image.image_utils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 {{(pid=94460) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 25 07:11:18 devstack cinder-volume[94460]: INFO cinder.image.image_utils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Converted 1024.00 MB image at 169.10 MB/s Aug 25 07:11:18 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 is being set with open permissions: ugo+rw Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:18 devstack sudo[114838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4 Aug 25 07:11:18 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:18 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 Aug 25 07:11:18 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:18 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285" returned: 0 in 0.252s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-dfbc677a-a011-43a6-9861-ab994e77c285" released by "_copy_volume_from_snapshot" :: held 7.283s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:18 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-efc97ebd-899c-445e-a460-364efc0b46b4" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-quobyte-efc97ebd-899c-445e-a460-364efc0b46b4" released by "delete_volume" :: held 1.349s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-1f15fcc8-aae6-476b-8212-9ca81f73f109-dfbc677a-a011-43a6-9861-ab994e77c285" released by "_create_volume_from_snapshot" :: held 7.396s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.438s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871702216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9276b0df-c75e-461d-94c6-86ea24b0ff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:16Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Creating volume 9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:18 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:18 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 1073741824 Aug 25 07:11:18 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245f75ca-929e-4237-99f3-fb9b4fff4d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbc677a-a011-43a6-9861-ab994e77c285', 'volume_size': 1, 'snapshot_id': '1f15fcc8-aae6-476b-8212-9ca81f73f109'}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1fd1e0-ed08-49f9-bfa4-a5d78f13ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Volume volume-dfbc677a-a011-43a6-9861-ab994e77c285 (dfbc677a-a011-43a6-9861-ab994e77c285): created successfully Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1fd1e0-ed08-49f9-bfa4-a5d78f13ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Flow 'volume_create_manager' (af53ca02-7efd-4e10-b306-7fe4be527b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:18 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Created reservations ['75287048-b62b-4c05-a1a3-835ae3c928ee', 'bceb59c9-da89-4f90-8c6f-ff198ecc561b', '21855146-ce79-4767-883d-a2ec359d4102', 'bcad75df-01ae-43c9-8e68-49407781da7b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-bd8501d1-edd0-4ff1-aa69-eee218b546bf tempest-SnapshotDependencyTests-1667282926 None] Created volume successfully. Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:19 devstack sudo[114846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:19 devstack sudo[114846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:19 devstack sudo[114846]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.332s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Deleted volume successfully. Aug 25 07:11:19 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 1073741824" returned: 0 in 0.531s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-8cd4326f-65be-4d9e-934f-fe9fedc79cb1 tempest-ProjectReaderTests-1687916709 None] Lock "cinder-efc97ebd-899c-445e-a460-364efc0b46b4-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:19 devstack sudo[114854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 Aug 25 07:11:19 devstack sudo[114854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-1f15fcc8-aae6-476b-8212-9ca81f73f109-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-1f15fcc8-aae6-476b-8212-9ca81f73f109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-quobyte-7fa34341-de13-4bc4-8269-d73809d2f9ed" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-7fa34341-de13-4bc4-8269-d73809d2f9ed" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-quobyte-1f15fcc8-aae6-476b-8212-9ca81f73f109" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-1f15fcc8-aae6-476b-8212-9ca81f73f109" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Deleting offline snapshot 1f15fcc8-aae6-476b-8212-9ca81f73f109 of volume 7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] snapshot_file for this snap is: volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee504be-022e-4b92-b207-4bc1cb01b4bb]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:19 devstack sudo[114854]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66" returned: 0 in 0.401s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb5742d-3c84-4b88-ab34-d2f735c18272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9276b0df-c75e-461d-94c6-86ea24b0ff66', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdecd9c-9f21-4719-aa0c-c66d53b5fadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Volume volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 (9276b0df-c75e-461d-94c6-86ea24b0ff66): created successfully Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdecd9c-9f21-4719-aa0c-c66d53b5fadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (5038175a-c23e-4786-9c2c-7172c021eae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d4d341b6-26cf-4a5c-82c9-3108cdfa5ffd tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:11:19 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 Aug 25 07:11:19 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:20 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109" returned: 0 in 0.434s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fa34341-de13-4bc4-8269-d73809d2f9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e121b-f70c-489a-8bbb-2ce59f9febe2]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:20 devstack sudo[114863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed Aug 25 07:11:20 devstack sudo[114863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot 5b31b479-4f59-4c11-a16f-3d2af1c80a1b of volume 9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[14080165-7ba7-4cd0-ad0b-31d6eada43a4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:21 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 Aug 25 07:11:21 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:21 devstack sudo[114863]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed" returned: 0 in 0.735s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:21 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 Aug 25 07:11:21 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:21 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66" returned: 0 in 0.481s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:21 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b 1G Aug 25 07:11:21 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:21 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109" returned: 0 in 0.475s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:21 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109 Aug 25 07:11:21 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:21 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed.1f15fcc8-aae6-476b-8212-9ca81f73f109" returned: 0 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-1f15fcc8-aae6-476b-8212-9ca81f73f109" released by "_delete_snapshot" :: held 2.118s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-7fa34341-de13-4bc4-8269-d73809d2f9ed" released by "delete_snapshot" :: held 2.148s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:21 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b 1G" returned: 0 in 0.628s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:22 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b Aug 25 07:11:22 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Created reservations ['383533b1-d257-4e9f-8737-1b482574fe2c', '62800663-c19e-4e03-85d0-b1aede65ee63', 'bbb18184-4356-4a08-b902-d661b74c2d44', '6803cc22-3542-44be-9ea3-2820f52ae95c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:22 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Delete snapshot completed successfully. Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-730b4131-9a89-4312-ba93-3bdc81dffcbb tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-1f15fcc8-aae6-476b-8212-9ca81f73f109-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:22 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b" returned: 0 in 0.382s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:22 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b is being set with open permissions: ugo+rw Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:22 devstack sudo[114892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b Aug 25 07:11:22 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:22 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b" returned: 0 in 0.264s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:22 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info Aug 25 07:11:22 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:22 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info" returned: 0 in 0.316s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:22 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info is being set with open permissions: ugo+rw Aug 25 07:11:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-7fa34341-de13-4bc4-8269-d73809d2f9ed-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:23 devstack sudo[114899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info Aug 25 07:11:23 devstack sudo[114899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-7fa34341-de13-4bc4-8269-d73809d2f9ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-quobyte-7fa34341-de13-4bc4-8269-d73809d2f9ed" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-7fa34341-de13-4bc4-8269-d73809d2f9ed" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d100d8f-6829-45ea-b30e-f4e6f1de49f5]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:23 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed Aug 25 07:11:23 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:23 devstack sudo[114899]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.info" returned: 0 in 0.389s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ea725565-0698-4f83-90d7-3a27044a7092 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:11:23 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed" returned: 0 in 0.549s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:23 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed Aug 25 07:11:23 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-5b31b479-4f59-4c11-a16f-3d2af1c80a1b-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-5b31b479-4f59-4c11-a16f-3d2af1c80a1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-9276b0df-c75e-461d-94c6-86ea24b0ff66" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-9276b0df-c75e-461d-94c6-86ea24b0ff66" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-5b31b479-4f59-4c11-a16f-3d2af1c80a1b" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-5b31b479-4f59-4c11-a16f-3d2af1c80a1b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:23 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot 5b31b479-4f59-4c11-a16f-3d2af1c80a1b of volume 9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a472a77-c6ae-434a-81c2-f6d3f74d2d70]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:24 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-7fa34341-de13-4bc4-8269-d73809d2f9ed" returned: 0 in 0.335s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-7fa34341-de13-4bc4-8269-d73809d2f9ed" released by "delete_volume" :: held 0.968s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Created reservations ['08802ee2-49cb-4ee4-bfcd-e33c2dd14ba0', '87a7bfe7-657a-472e-b513-f0017653dd82', '2bddcfd4-273f-4691-951d-32ce9eaa304a', '0da6359c-eae0-47cf-9757-c892838b8f9c'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:24 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b Aug 25 07:11:24 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:24 devstack sudo[114946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:24 devstack sudo[114946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-dfbc677a-a011-43a6-9861-ab994e77c285-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-dfbc677a-a011-43a6-9861-ab994e77c285-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "cinder-quobyte-dfbc677a-a011-43a6-9861-ab994e77c285" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-dfbc677a-a011-43a6-9861-ab994e77c285" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457d078-6344-4550-ab01-0134bd8f4785]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:24 devstack sudo[114946]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.432s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:24 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Deleted volume successfully. Aug 25 07:11:24 devstack sudo[114950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 Aug 25 07:11:24 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-405277a2-c68d-4781-a461-ce01398a0c98 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-7fa34341-de13-4bc4-8269-d73809d2f9ed-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:24 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b" returned: 0 in 0.748s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9276b0df-c75e-461d-94c6-86ea24b0ff66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7859e42-5d9f-4c4f-bb6d-852ab1679973]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:24 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 Aug 25 07:11:24 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:25 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285" returned: 0 in 0.497s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:25 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285 Aug 25 07:11:25 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:25 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66" returned: 0 in 0.478s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:25 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b Aug 25 07:11:25 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:25 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-dfbc677a-a011-43a6-9861-ab994e77c285" returned: 0 in 0.345s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-quobyte-dfbc677a-a011-43a6-9861-ab994e77c285" released by "delete_volume" :: held 0.910s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Created reservations ['7a9a19a1-e394-4c65-ae78-62254bc67d5e', '114ef135-e46b-4bf3-9955-3cbb871fdfd3', '168c7f1b-8ad3-46bb-8900-ef7b744e7f47', '55bb2ede-eca6-4c72-93ce-aa644d28a57d'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:25 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:25 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:25 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b" returned: 0 in 0.598s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:25 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b Aug 25 07:11:25 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:26 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.459s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Deleted volume successfully. Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-fd43b1dd-3cd4-46bf-949c-37ff0a2880a8 tempest-SnapshotDependencyTests-1667282926 None] Lock "cinder-dfbc677a-a011-43a6-9861-ab994e77c285-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:26 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66.5b31b479-4f59-4c11-a16f-3d2af1c80a1b" returned: 0 in 0.299s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-5b31b479-4f59-4c11-a16f-3d2af1c80a1b" released by "_delete_snapshot" :: held 2.260s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-9276b0df-c75e-461d-94c6-86ea24b0ff66" released by "delete_snapshot" :: held 2.280s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Created reservations ['07b557d4-4785-4ba8-826d-10ea3632ad2b', '71cc5038-ae35-42ea-a685-b77c74123e8d', '9e518556-65fd-4e13-a591-46f513c580b4', 'a36977df-f3f2-49fe-9202-feed9732b331'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:26 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:11:26 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-ec19f249-ce82-4183-8ce4-fb3532d0dcb8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-5b31b479-4f59-4c11-a16f-3d2af1c80a1b-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-9276b0df-c75e-461d-94c6-86ea24b0ff66-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-9276b0df-c75e-461d-94c6-86ea24b0ff66-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-9276b0df-c75e-461d-94c6-86ea24b0ff66" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:27 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-9276b0df-c75e-461d-94c6-86ea24b0ff66" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:27 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b7828-b123-4927-91c0-7d7be794d8d0]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:27 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:27 devstack sudo[114979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 Aug 25 07:11:27 devstack sudo[114979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:28 devstack sudo[114979]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66" returned: 0 in 0.524s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:28 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66 Aug 25 07:11:28 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:28 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-9276b0df-c75e-461d-94c6-86ea24b0ff66" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-9276b0df-c75e-461d-94c6-86ea24b0ff66" released by "delete_volume" :: held 0.953s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Created reservations ['d578bc0e-48a2-426a-889f-49425337df9a', 'fde50cd2-cda8-4168-8b19-40bf709e8f71', '7629dfff-2cb9-4ab1-a7be-be4be3f579ba', '6b635d94-2c09-48b1-8c9b-31eac5b71009'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:28 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:28 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:28 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:28 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:11:28 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-b410f1f4-56f2-49cd-83c3-3e521a026288 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-9276b0df-c75e-461d-94c6-86ea24b0ff66-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (9d23816b-7eff-4e47-9b3c-f6c98363ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c063302a-7078-4aed-a092-b825351963f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c063302a-7078-4aed-a092-b825351963f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81693616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb95fff9-545c-4d5b-9cfd-82e6d012a56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:30Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34082c63-3ca6-4073-b94c-3bd7c309187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34082c63-3ca6-4073-b94c-3bd7c309187d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f90842-0f5f-4a32-a964-6af27f5d8498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f90842-0f5f-4a32-a964-6af27f5d8498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb95fff9-545c-4d5b-9cfd-82e6d012a56d', 'volume_name': 'volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5f6927-4085-4f8b-98a6-bf1bea669cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5f6927-4085-4f8b-98a6-bf1bea669cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7b1cfb-040f-4ddf-b847-39b942baf617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:30 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Volume eb95fff9-545c-4d5b-9cfd-82e6d012a56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d', 'volume_size': 1} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81693616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb95fff9-545c-4d5b-9cfd-82e6d012a56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:30Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Creating volume eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:30 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:30 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:30 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d 1073741824 Aug 25 07:11:30 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:31 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (eecb46e7-f382-405d-a634-84283b56b5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb51b106-9469-4da5-a716-d7289d37f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d 1073741824" returned: 0 in 0.611s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb51b106-9469-4da5-a716-d7289d37f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384191200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdac6d66-4e6a-44cd-9842-ba3157a91d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:31Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a67dc2-1475-4b31-a42a-290ba0750599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a67dc2-1475-4b31-a42a-290ba0750599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b075c231-d2e2-4973-ba88-2a8793e641fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b075c231-d2e2-4973-ba88-2a8793e641fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdac6d66-4e6a-44cd-9842-ba3157a91d28', 'volume_name': 'volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05adcadf-54a3-44a8-975c-198682564eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05adcadf-54a3-44a8-975c-198682564eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bacf424-89ca-4d66-8a79-36a1a52bd8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:31 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Volume cdac6d66-4e6a-44cd-9842-ba3157a91d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28', 'volume_size': 1} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:31 devstack sudo[114999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d Aug 25 07:11:31 devstack sudo[114999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:31 devstack sudo[114999]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" returned: 0 in 0.277s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384191200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdac6d66-4e6a-44cd-9842-ba3157a91d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:31Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Creating volume cdac6d66-4e6a-44cd-9842-ba3157a91d28 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:31 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7b1cfb-040f-4ddf-b847-39b942baf617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c7dfe6-e639-4755-84e2-f4b6cf80928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:31 devstack sudo[115002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 1073741824 Aug 25 07:11:31 devstack sudo[115002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:31 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Volume volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d (eb95fff9-545c-4d5b-9cfd-82e6d012a56d): created successfully Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c7dfe6-e639-4755-84e2-f4b6cf80928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (9d23816b-7eff-4e47-9b3c-f6c98363ab86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:31 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-ab2ff856-e20c-46e9-b8d3-ff1d251942ff tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:31 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:31 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:32 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:32 devstack sudo[115002]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.397s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 1073741824" returned: 0 in 0.669s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:32 devstack sudo[115012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 Aug 25 07:11:32 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:32 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28" returned: 0 in 0.336s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bacf424-89ca-4d66-8a79-36a1a52bd8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4797b85-8b7d-4895-aeea-e304a414412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:32 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Volume volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 (cdac6d66-4e6a-44cd-9842-ba3157a91d28): created successfully Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4797b85-8b7d-4895-aeea-e304a414412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (eecb46e7-f382-405d-a634-84283b56b5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:32 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2199167c-166c-4254-8478-9d9f40682201 tempest-ProjectReaderTests-1305929783 None] Created volume successfully. Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot fe878928-1fe1-464d-b238-32d045c503fa of volume eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b500ad8-753b-402d-a97d-bf1e22b07057]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:32 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d Aug 25 07:11:32 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:33 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" returned: 0 in 0.477s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:33 devstack sudo[115026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa 1G Aug 25 07:11:33 devstack sudo[115026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-cdac6d66-4e6a-44cd-9842-ba3157a91d28-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-cdac6d66-4e6a-44cd-9842-ba3157a91d28-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-quobyte-cdac6d66-4e6a-44cd-9842-ba3157a91d28" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-cdac6d66-4e6a-44cd-9842-ba3157a91d28" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e881ce-f2f5-4966-a65f-9f5677106fbd]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:33 devstack sudo[115026]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa 1G" returned: 0 in 0.582s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:33 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:33 devstack sudo[115031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 Aug 25 07:11:33 devstack sudo[115031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:33 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa Aug 25 07:11:33 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:34 devstack sudo[115031]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28" returned: 0 in 0.460s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:34 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa" returned: 0 in 0.390s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:34 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa is being set with open permissions: ugo+rw Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:34 devstack sudo[115046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28 Aug 25 07:11:34 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:34 devstack sudo[115047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa Aug 25 07:11:34 devstack sudo[115047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:34 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-cdac6d66-4e6a-44cd-9842-ba3157a91d28" returned: 0 in 0.314s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-cdac6d66-4e6a-44cd-9842-ba3157a91d28" released by "delete_volume" :: held 0.837s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:34 devstack sudo[115047]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa" returned: 0 in 0.312s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:34 devstack sudo[115052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info Aug 25 07:11:34 devstack sudo[115052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Created reservations ['c33227c7-1b37-459f-bf64-57a1e48198e1', '42951bd9-84fd-4dfd-a27d-c89fa8dedb04', 'ab766a01-af11-4c83-a727-d739e818c955', '31e3d6c7-b216-4373-bb72-6a672ad95b11'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:34 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:34 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:34 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:35 devstack sudo[115052]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info" returned: 0 in 0.442s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:35 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:35 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info is being set with open permissions: ugo+rw Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.297s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Deleted volume successfully. Aug 25 07:11:35 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info Aug 25 07:11:35 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d746b070-e5a3-49b2-ae96-eaa383183e30 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-cdac6d66-4e6a-44cd-9842-ba3157a91d28-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:35 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.info" returned: 0 in 0.385s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.715s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:35 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-feb7d6b5-de46-4982-ad66-a3b01ac1a6a0 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (b46f1e5d-06f7-4d0d-9eea-5629a23e0b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b66709-a851-458e-84d3-855c5b821f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b66709-a851-458e-84d3-855c5b821f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62597614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0137f4d-2ea2-4a39-9520-92a4da379ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:35Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d7d7b-67f9-4dc4-aeaa-254c32628ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d7d7b-67f9-4dc4-aeaa-254c32628ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2932a5-d406-4c0b-98bf-66bdccb9a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2932a5-d406-4c0b-98bf-66bdccb9a06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0137f4d-2ea2-4a39-9520-92a4da379ac4', 'volume_name': 'volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96819c3-b70c-4c50-b997-d77bba7ca8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96819c3-b70c-4c50-b997-d77bba7ca8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5f6586-ea37-486c-9d12-dc867545aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:35 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Volume d0137f4d-2ea2-4a39-9520-92a4da379ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4', 'volume_size': 1} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62597614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0137f4d-2ea2-4a39-9520-92a4da379ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:35Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Creating volume d0137f4d-2ea2-4a39-9520-92a4da379ac4 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:35 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:35 devstack sudo[115061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 1073741824 Aug 25 07:11:35 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-fe878928-1fe1-464d-b238-32d045c503fa-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-fe878928-1fe1-464d-b238-32d045c503fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-fe878928-1fe1-464d-b238-32d045c503fa" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-fe878928-1fe1-464d-b238-32d045c503fa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot fe878928-1fe1-464d-b238-32d045c503fa of volume eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebe80a4-c0c5-4479-847d-50c89e806249]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:35 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:36 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 1073741824" returned: 0 in 0.475s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:36 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa Aug 25 07:11:36 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:36 devstack sudo[115069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 Aug 25 07:11:36 devstack sudo[115069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:36 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa" returned: 0 in 0.459s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce0844-4c92-4796-b82a-3ca07ce10b81]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:36 devstack sudo[115069]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4" returned: 0 in 0.395s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5f6586-ea37-486c-9d12-dc867545aa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f638523-2d5a-435c-a9b2-7fbb4bb00b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:36 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Volume volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 (d0137f4d-2ea2-4a39-9520-92a4da379ac4): created successfully Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f638523-2d5a-435c-a9b2-7fbb4bb00b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (b46f1e5d-06f7-4d0d-9eea-5629a23e0b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:36 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-83f14fb3-9491-42d7-aefa-2166deef53cd tempest-ProjectReaderTests-1305929783 None] Created volume successfully. Aug 25 07:11:36 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d Aug 25 07:11:36 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:36 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" returned: 0 in 0.445s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:36 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:36 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa Aug 25 07:11:36 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:37 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa" returned: 0 in 0.348s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:37 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa Aug 25 07:11:37 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:37 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d.fe878928-1fe1-464d-b238-32d045c503fa" returned: 0 in 0.291s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-fe878928-1fe1-464d-b238-32d045c503fa" released by "_delete_snapshot" :: held 1.700s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" released by "delete_snapshot" :: held 1.741s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-d0137f4d-2ea2-4a39-9520-92a4da379ac4-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-d0137f4d-2ea2-4a39-9520-92a4da379ac4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-quobyte-d0137f4d-2ea2-4a39-9520-92a4da379ac4" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Created reservations ['73c58733-7cd5-4551-998e-5c734148776f', '573a47cc-a0d4-4f88-8a29-04a89fcd098d', 'd3b549bf-ac2d-429c-bf9c-86d75a7a23a9', '77b2a50c-251f-40c2-ba07-056ce2694ad6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-d0137f4d-2ea2-4a39-9520-92a4da379ac4" acquired by "delete_volume" :: waited 0.046s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d852cc-7a57-45d5-8d8e-b7c93dcb4b96]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:37 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:11:37 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-146d56ac-8152-4010-a5de-ca0651bbe50c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-fe878928-1fe1-464d-b238-32d045c503fa-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:38 devstack sudo[115089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 Aug 25 07:11:38 devstack sudo[115089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-eb95fff9-545c-4d5b-9cfd-82e6d012a56d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-eb95fff9-545c-4d5b-9cfd-82e6d012a56d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" acquired by "delete_volume" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc0acc-34f8-4f70-9c60-6da75924e8e1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:38 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d Aug 25 07:11:38 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:38 devstack sudo[115089]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4" returned: 0 in 0.526s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:38 devstack sudo[115098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4 Aug 25 07:11:38 devstack sudo[115098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:38 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" returned: 0 in 0.516s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:38 devstack sudo[115104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d Aug 25 07:11:38 devstack sudo[115104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:38 devstack sudo[115098]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d0137f4d-2ea2-4a39-9520-92a4da379ac4" returned: 0 in 0.418s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-d0137f4d-2ea2-4a39-9520-92a4da379ac4" released by "delete_volume" :: held 1.019s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:38 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Created reservations ['7eaeb8fc-1f09-4879-a5ba-b859879c631f', 'b36a2db1-99e1-4509-85a5-ac1ca41d30d8', '93152574-c1f3-41a1-a79f-b3b80764a70e', 'd7b7238e-06e9-45d8-b5c0-f419f9acf8f8'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:39 devstack sudo[115107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:39 devstack sudo[115107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:39 devstack sudo[115104]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" returned: 0 in 0.329s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-eb95fff9-545c-4d5b-9cfd-82e6d012a56d" released by "delete_volume" :: held 0.929s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Created reservations ['2e6e0646-48b4-49de-8203-482aad0f1b99', '5ba8d1cd-0c16-4741-98e4-d51b643e5509', '5ce4145a-1762-449c-a4e0-2ed69c00b6ee', '1ad2b05d-8690-42aa-a24a-d3b9e96af332'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:39 devstack sudo[115107]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.298s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Deleted volume successfully. Aug 25 07:11:39 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:39 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-d26620cf-bbac-497b-9f13-cdd2a5893383 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-d0137f4d-2ea2-4a39-9520-92a4da379ac4-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:39 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.371s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:39 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c28e8b26-b82d-4aac-8720-08237e778a88 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-eb95fff9-545c-4d5b-9cfd-82e6d012a56d-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (695d8028-5a71-47e5-bcad-4ec7d9722d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974f9379-d6c2-4194-b4dc-dfbae5394179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:39 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974f9379-d6c2-4194-b4dc-dfbae5394179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996073415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcb81d6-5b36-4901-948e-1ee113d90d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:40Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584032b4-fe5d-43b9-a4b9-897ff6b04680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584032b4-fe5d-43b9-a4b9-897ff6b04680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacaa295-5eb5-40a4-b9d6-7e2a0253801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacaa295-5eb5-40a4-b9d6-7e2a0253801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcb81d6-5b36-4901-948e-1ee113d90d46', 'volume_name': 'volume-3fcb81d6-5b36-4901-948e-1ee113d90d46', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd364f0-144a-457b-963c-f34e530d9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd364f0-144a-457b-963c-f34e530d9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58828fbf-09f3-4730-9d8a-3ce24c6fa87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Volume 3fcb81d6-5b36-4901-948e-1ee113d90d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcb81d6-5b36-4901-948e-1ee113d90d46', 'volume_size': 1} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996073415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcb81d6-5b36-4901-948e-1ee113d90d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:40Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Creating volume 3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:40 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:40 devstack sudo[115114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 1073741824 Aug 25 07:11:40 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:40 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 1073741824" returned: 0 in 0.556s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:40 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 Aug 25 07:11:40 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (31859363-9b36-4662-b4aa-6c186a4633d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7538b8-cc88-4e7d-ae56-23cebfa6415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7538b8-cc88-4e7d-ae56-23cebfa6415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122096980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:41Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e418f2-951a-46d5-8134-eed070c183b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e418f2-951a-46d5-8134-eed070c183b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453cea4b-c134-4377-8b1c-413a852b5828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453cea4b-c134-4377-8b1c-413a852b5828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca', 'volume_name': 'volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24df18c1-dac6-4a28-8b67-a3c85edf8df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24df18c1-dac6-4a28-8b67-a3c85edf8df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a084e81-3bf9-417e-83c3-6bf38853311f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:40 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Volume 63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca', 'volume_size': 1} Aug 25 07:11:40 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:41 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122096980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:41Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Creating volume 63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:41 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58828fbf-09f3-4730-9d8a-3ce24c6fa87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcb81d6-5b36-4901-948e-1ee113d90d46', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:41 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca 1073741824 Aug 25 07:11:41 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245b4d54-1a14-4eef-aad0-0cb5658f725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Volume volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 (3fcb81d6-5b36-4901-948e-1ee113d90d46): created successfully Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245b4d54-1a14-4eef-aad0-0cb5658f725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (695d8028-5a71-47e5-bcad-4ec7d9722d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7617e865-4d6b-4faa-baab-3a9b26c5b8b0 tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:11:41 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca 1073741824" returned: 0 in 0.409s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:41 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca Aug 25 07:11:41 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:41 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a084e81-3bf9-417e-83c3-6bf38853311f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad5ebf2-f732-428e-81e4-b7a2cb079b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:41 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Volume volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca (63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca): created successfully Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad5ebf2-f732-428e-81e4-b7a2cb079b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:41 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (31859363-9b36-4662-b4aa-6c186a4633d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:41 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-2876bc15-7715-4b9b-ac12-c07693c10de1 tempest-ProjectReaderTests-1305929783 None] Created volume successfully. Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot 2204b192-f9a9-40ab-8ab3-c074f43f9bd0 of volume 3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a56ce-8664-48a0-932a-c34cf5ba8ec1]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:42 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 Aug 25 07:11:42 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:42 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46" returned: 0 in 0.393s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:42 devstack sudo[115136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 1G Aug 25 07:11:42 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-quobyte-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[186289e5-22a0-4c05-931a-857413c355db]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:42 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:43 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca Aug 25 07:11:43 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:43 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 1G" returned: 0 in 0.444s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:43 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 Aug 25 07:11:43 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:43 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca" returned: 0 in 0.392s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:43 devstack sudo[115151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca Aug 25 07:11:43 devstack sudo[115151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:43 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0" returned: 0 in 0.318s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:43 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 is being set with open permissions: ugo+rw Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:43 devstack sudo[115155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 Aug 25 07:11:43 devstack sudo[115155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:43 devstack sudo[115151]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca" returned: 0 in 0.284s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca" released by "delete_volume" :: held 0.718s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:43 devstack sudo[115155]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0" returned: 0 in 0.278s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Created reservations ['59557abb-ef82-40a6-9444-04fa7ee2bdd7', '6501e38f-f800-490c-bf4d-c757d8098ae7', 'e970cd19-6521-46d2-8ea0-c68516bb9689', '3d4fc1eb-8a6b-43e7-aa8b-083a6b8510bf'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:43 devstack sudo[115159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info Aug 25 07:11:43 devstack sudo[115159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:43 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:43 devstack sudo[115161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:43 devstack sudo[115161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:44 devstack sudo[115159]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info" returned: 0 in 0.365s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:44 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info is being set with open permissions: ugo+rw Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:44 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info Aug 25 07:11:44 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:44 devstack sudo[115161]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.351s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Deleted volume successfully. Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-285ceabd-4f7a-4b62-8462-a40f71f9cc14 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-63d68aa7-3f1f-4b9f-a7bb-efef7caa4cca-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:44 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.info" returned: 0 in 0.309s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:44 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-19e38d24-c0fd-4bf4-9b63-02a5e041e420 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (30396635-cfd5-4c15-8118-2ffc8e38665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1250a5a-5645-4c86-9da7-5b41e1a7105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1250a5a-5645-4c86-9da7-5b41e1a7105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217440839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92838785-c1b1-4496-8a5e-c76701e7e60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:45Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5212e54-00c1-4e1a-9bb6-a80045c0e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5212e54-00c1-4e1a-9bb6-a80045c0e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae91931-9be6-44f2-a851-22a81a8a14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae91931-9be6-44f2-a851-22a81a8a14ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92838785-c1b1-4496-8a5e-c76701e7e60a', 'volume_name': 'volume-92838785-c1b1-4496-8a5e-c76701e7e60a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f00940-c3f3-48b7-ad7d-b3be77fdac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f00940-c3f3-48b7-ad7d-b3be77fdac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7ddf39-8cf8-4883-8327-ab318dfcb37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:44 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Volume 92838785-c1b1-4496-8a5e-c76701e7e60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92838785-c1b1-4496-8a5e-c76701e7e60a', 'volume_size': 1} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217440839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92838785-c1b1-4496-8a5e-c76701e7e60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633e2f2da1eb4ad8b414f2e958ed1299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:45Z,use_quota=True,user_id='f630445a013a4092a54a32ae9c2c3ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Creating volume 92838785-c1b1-4496-8a5e-c76701e7e60a {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:44 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:44 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:44 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a 1073741824 Aug 25 07:11:44 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:45 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a 1073741824" returned: 0 in 0.437s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:45 devstack sudo[115173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a Aug 25 07:11:45 devstack sudo[115173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:45 devstack sudo[115173]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-2204b192-f9a9-40ab-8ab3-c074f43f9bd0-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a" returned: 0 in 0.270s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-2204b192-f9a9-40ab-8ab3-c074f43f9bd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-3fcb81d6-5b36-4901-948e-1ee113d90d46" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7ddf39-8cf8-4883-8327-ab318dfcb37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92838785-c1b1-4496-8a5e-c76701e7e60a', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f62610-92f6-4ce4-82e3-f041034ec357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:45 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Volume volume-92838785-c1b1-4496-8a5e-c76701e7e60a (92838785-c1b1-4496-8a5e-c76701e7e60a): created successfully Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f62610-92f6-4ce4-82e3-f041034ec357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Flow 'volume_create_manager' (30396635-cfd5-4c15-8118-2ffc8e38665e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-3fcb81d6-5b36-4901-948e-1ee113d90d46" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-2204b192-f9a9-40ab-8ab3-c074f43f9bd0" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-2204b192-f9a9-40ab-8ab3-c074f43f9bd0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot 2204b192-f9a9-40ab-8ab3-c074f43f9bd0 of volume 3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:45 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-44b3b9b2-0b9a-45c7-9da2-449e5a4f468a tempest-ProjectReaderTests-1305929783 None] Created volume successfully. Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b9540e-effb-43d3-9c95-90a26a8ccc53]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:45 devstack sudo[115176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 Aug 25 07:11:45 devstack sudo[115176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:45 devstack sudo[115176]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0" returned: 0 in 0.383s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fcb81d6-5b36-4901-948e-1ee113d90d46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde04c9f-3bde-4dda-963a-be6793605a60]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:45 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:46 devstack sudo[115181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 Aug 25 07:11:46 devstack sudo[115181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:46 devstack sudo[115181]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46" returned: 0 in 0.365s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:46 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 Aug 25 07:11:46 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-92838785-c1b1-4496-8a5e-c76701e7e60a-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:46 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0" returned: 0 in 0.379s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-92838785-c1b1-4496-8a5e-c76701e7e60a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:46 devstack sudo[115192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0 Aug 25 07:11:46 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "cinder-quobyte-92838785-c1b1-4496-8a5e-c76701e7e60a" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-92838785-c1b1-4496-8a5e-c76701e7e60a" acquired by "delete_volume" :: waited 0.021s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f1d41-083a-484a-9151-c954e11904cc]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:46 devstack sudo[115194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a Aug 25 07:11:46 devstack sudo[115194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:46 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46.2204b192-f9a9-40ab-8ab3-c074f43f9bd0" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-2204b192-f9a9-40ab-8ab3-c074f43f9bd0" released by "_delete_snapshot" :: held 1.486s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:46 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-3fcb81d6-5b36-4901-948e-1ee113d90d46" released by "delete_snapshot" :: held 1.511s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Created reservations ['17f9f781-dd58-40dc-9335-fb5c48f873ff', 'defb9bc3-2da2-4f39-827e-ae153a6c1dd7', '5eca912a-4e4a-4439-bb2c-0e658d169ace', '1ed0d705-847d-4602-aa12-ea365992b697'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:47 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-28c2ac59-e8b4-4086-9a7d-0ad5b43c8a76 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-2204b192-f9a9-40ab-8ab3-c074f43f9bd0-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:47 devstack sudo[115194]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:47 devstack sudo[115200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a Aug 25 07:11:47 devstack sudo[115200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:47 devstack sudo[115200]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-92838785-c1b1-4496-8a5e-c76701e7e60a" returned: 0 in 0.238s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-quobyte-92838785-c1b1-4496-8a5e-c76701e7e60a" released by "delete_volume" :: held 0.648s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:INSERT=72,cinder:UPDATE=267,cinder:SELECT=205,cinder:DELETE=27 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:SELECT=213,cinder:UPDATE=277,cinder:INSERT=71,cinder:DELETE=18 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Created reservations ['9573628a-ea11-47f0-acad-6df1d8fc4685', 'ba007952-a700-45ca-b8c1-c151393c9851', '0d4f121d-769b-44b3-9f1e-765f710df3df', '1971dbfe-9a43-4739-9f39-8d72e5a0537e'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-3fcb81d6-5b36-4901-948e-1ee113d90d46-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-3fcb81d6-5b36-4901-948e-1ee113d90d46-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:47 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:47 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-3fcb81d6-5b36-4901-948e-1ee113d90d46" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-3fcb81d6-5b36-4901-948e-1ee113d90d46" acquired by "delete_volume" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[a676e07d-ceb6-4058-90ac-b55dca5b4da3]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:47 devstack sudo[115205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 Aug 25 07:11:47 devstack sudo[115205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:47 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:47 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Deleted volume successfully. Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f33fe0ee-275e-41a6-852d-62995eaefb73 tempest-ProjectReaderTests-1305929783 None] Lock "cinder-92838785-c1b1-4496-8a5e-c76701e7e60a-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:48 devstack sudo[115205]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46" returned: 0 in 0.459s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:48 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46 Aug 25 07:11:48 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:48 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-3fcb81d6-5b36-4901-948e-1ee113d90d46" returned: 0 in 0.283s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-3fcb81d6-5b36-4901-948e-1ee113d90d46" released by "delete_volume" :: held 0.824s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Created reservations ['498ac5b1-a44e-4bbc-a5ef-40d4fcae9d2a', '26210c78-2fe7-45b6-bf09-333c9e1c782a', 'dab16792-6adc-45c2-89cf-ec197fbf8bc8', 'd317f81f-cab6-4575-b520-6a866ad1a391'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:48 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:48 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:48 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:48 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:48 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-6a4b55a5-dab9-47ae-ba25-00bfebb1540f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-3fcb81d6-5b36-4901-948e-1ee113d90d46-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (eb202f1a-5ce7-4781-bf78-34058769af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e100d556-bfeb-496b-aa4a-c6029f66be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e100d556-bfeb-496b-aa4a-c6029f66be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123252625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048432b3-26ed-4864-b5bf-d400fa78e570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:49Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161ded3c-1493-4d13-ad57-3eb6ea2dcc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161ded3c-1493-4d13-ad57-3eb6ea2dcc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0486034-7f8a-4e6f-a487-5c9c6ba00246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0486034-7f8a-4e6f-a487-5c9c6ba00246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048432b3-26ed-4864-b5bf-d400fa78e570', 'volume_name': 'volume-048432b3-26ed-4864-b5bf-d400fa78e570', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2101cb-30fb-4045-9f8c-c0239d0f8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2101cb-30fb-4045-9f8c-c0239d0f8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad74b7-37e2-4a50-9fb0-12a62cb0e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:49 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Volume 048432b3-26ed-4864-b5bf-d400fa78e570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048432b3-26ed-4864-b5bf-d400fa78e570', 'volume_size': 1} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123252625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048432b3-26ed-4864-b5bf-d400fa78e570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:49Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Creating volume 048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:49 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:49 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:49 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 1073741824 Aug 25 07:11:49 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:49 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 1073741824" returned: 0 in 0.615s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:50 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 Aug 25 07:11:50 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:50 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad74b7-37e2-4a50-9fb0-12a62cb0e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048432b3-26ed-4864-b5bf-d400fa78e570', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6103931-ac6d-49dc-822f-3c45c7777ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:50 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Volume volume-048432b3-26ed-4864-b5bf-d400fa78e570 (048432b3-26ed-4864-b5bf-d400fa78e570): created successfully Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6103931-ac6d-49dc-822f-3c45c7777ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:50 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (eb202f1a-5ce7-4781-bf78-34058769af9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:50 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-abf1bbdd-2cbd-42f7-98fa-f26afeef11ca tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:11:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:51 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot e68ccddb-5b52-4778-90c5-06bd1fd7db89 of volume 048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:51 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[e168fc7c-7ab7-4a57-8ad1-34c6c98e4cf9]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:51 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:51 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 Aug 25 07:11:51 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:52 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570" returned: 0 in 0.387s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:52 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 1G Aug 25 07:11:52 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:52 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 1G" returned: 0 in 0.384s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048432b3-26ed-4864-b5bf-d400fa78e570 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:52 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048432b3-26ed-4864-b5bf-d400fa78e570 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 Aug 25 07:11:52 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:52 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048432b3-26ed-4864-b5bf-d400fa78e570 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89" returned: 0 in 0.290s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:52 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 is being set with open permissions: ugo+rw Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:52 devstack sudo[115244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 Aug 25 07:11:52 devstack sudo[115244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:52 devstack sudo[115244]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:52 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:52 devstack sudo[115247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info Aug 25 07:11:52 devstack sudo[115247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:53 devstack sudo[115247]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info" returned: 0 in 0.242s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:53 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info is being set with open permissions: ugo+rw Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:53 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info Aug 25 07:11:53 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:53 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.info" returned: 0 in 0.229s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:53 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7e7e8c9f-2cff-4dd3-80bd-9e67fb16bb6e tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-e68ccddb-5b52-4778-90c5-06bd1fd7db89-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-e68ccddb-5b52-4778-90c5-06bd1fd7db89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-048432b3-26ed-4864-b5bf-d400fa78e570" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-048432b3-26ed-4864-b5bf-d400fa78e570" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-e68ccddb-5b52-4778-90c5-06bd1fd7db89" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-e68ccddb-5b52-4778-90c5-06bd1fd7db89" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot e68ccddb-5b52-4778-90c5-06bd1fd7db89 of volume 048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb48b44-b10f-4c95-b879-879acc883b09]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:53 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:53 devstack sudo[115253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 Aug 25 07:11:53 devstack sudo[115253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:54 devstack sudo[115253]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-048432b3-26ed-4864-b5bf-d400fa78e570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[475eb83a-1841-48a1-960a-185d82b25548]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:54 devstack sudo[115258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 Aug 25 07:11:54 devstack sudo[115258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:54 devstack sudo[115258]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570" returned: 0 in 0.380s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:54 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 Aug 25 07:11:54 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:54 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89" returned: 0 in 0.339s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:54 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:54 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89 Aug 25 07:11:54 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:55 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570.e68ccddb-5b52-4778-90c5-06bd1fd7db89" returned: 0 in 0.258s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-e68ccddb-5b52-4778-90c5-06bd1fd7db89" released by "_delete_snapshot" :: held 1.417s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-048432b3-26ed-4864-b5bf-d400fa78e570" released by "delete_snapshot" :: held 1.441s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Created reservations ['2d8232a5-ab15-46d6-871e-43c17de81207', 'eb0c240f-67bd-4c4f-a540-93802bd052c3', '5600b69f-5449-40e9-ac3b-98b7870f4e50', 'daa41eba-dadc-43f4-8df8-50a8e31aea26'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:55 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-7b9fa224-8de2-45e9-96f9-fe2cef359976 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-e68ccddb-5b52-4778-90c5-06bd1fd7db89-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-048432b3-26ed-4864-b5bf-d400fa78e570-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-048432b3-26ed-4864-b5bf-d400fa78e570-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-048432b3-26ed-4864-b5bf-d400fa78e570" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-048432b3-26ed-4864-b5bf-d400fa78e570" acquired by "delete_volume" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d0e471-6a11-4fa4-89ba-9c1a928191ca]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:55 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:56 devstack sudo[115273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 Aug 25 07:11:56 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:56 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570" returned: 0 in 0.361s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:56 devstack sudo[115278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570 Aug 25 07:11:56 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:56 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-048432b3-26ed-4864-b5bf-d400fa78e570" returned: 0 in 0.247s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-048432b3-26ed-4864-b5bf-d400fa78e570" released by "delete_volume" :: held 0.662s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Created reservations ['07e4cce1-f3de-4cf7-9fe4-f0023dd0f3ec', '3bc20e8f-93f9-4b3e-97c2-f39cde30b890', '0a6a1334-f4ae-40d3-8367-d8130b3cf0cc', 'c2d2c847-ab57-49ab-8b90-3559575facb6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:56 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:56 devstack sudo[115281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:11:56 devstack sudo[115281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:57 devstack sudo[115281]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.275s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:11:57 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f069460f-3d8c-49d4-b50b-74787ea13b83 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-048432b3-26ed-4864-b5bf-d400fa78e570-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (7a1fc461-8389-418b-b2fd-506e62de803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc20040-4cdc-4938-a727-21e1ee4e7ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc20040-4cdc-4938-a727-21e1ee4e7ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1138762698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ebc9a6-4cbe-4989-8033-9cad61d33307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:57Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8530eff0-011f-4953-a2df-44a891545364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8530eff0-011f-4953-a2df-44a891545364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df72c39b-dd57-415f-9d5c-5762e5dc2bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df72c39b-dd57-415f-9d5c-5762e5dc2bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ebc9a6-4cbe-4989-8033-9cad61d33307', 'volume_name': 'volume-59ebc9a6-4cbe-4989-8033-9cad61d33307', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bda0909-118b-403e-bb93-61cd3450d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bda0909-118b-403e-bb93-61cd3450d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ccb9ac-bd3b-467e-ac13-67b488292b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:57 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Volume 59ebc9a6-4cbe-4989-8033-9cad61d33307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ebc9a6-4cbe-4989-8033-9cad61d33307', 'volume_size': 1} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1138762698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ebc9a6-4cbe-4989-8033-9cad61d33307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:11:57Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Creating volume 59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:11:57 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:11:57 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:57 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 1073741824 Aug 25 07:11:57 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:58 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 1073741824" returned: 0 in 0.415s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:58 devstack sudo[115290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 Aug 25 07:11:58 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:58 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ccb9ac-bd3b-467e-ac13-67b488292b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ebc9a6-4cbe-4989-8033-9cad61d33307', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf76f565-8391-4f87-bdd0-7f3dd7593626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:11:58 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Volume volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 (59ebc9a6-4cbe-4989-8033-9cad61d33307): created successfully Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf76f565-8391-4f87-bdd0-7f3dd7593626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (7a1fc461-8389-418b-b2fd-506e62de803c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:11:58 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-128ece57-7afa-44dc-9e55-6090455e22fc tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot 25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 of volume 59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c589550d-be62-493d-9be3-31b9175cd7ca]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:11:58 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:58 devstack sudo[115293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 Aug 25 07:11:58 devstack sudo[115293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:59 devstack sudo[115293]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307" returned: 0 in 0.369s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:59 devstack sudo[115298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 1G Aug 25 07:11:59 devstack sudo[115298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:59 devstack sudo[115298]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 1G" returned: 0 in 0.398s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:59 devstack sudo[115303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 Aug 25 07:11:59 devstack sudo[115303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:11:59 devstack sudo[115303]: pam_unix(sudo:session): session closed for user root Aug 25 07:11:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:11:59 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 is being set with open permissions: ugo+rw Aug 25 07:11:59 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:11:59 devstack sudo[115308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 Aug 25 07:11:59 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:00 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" returned: 0 in 0.254s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:00 devstack sudo[115312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info Aug 25 07:12:00 devstack sudo[115312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:00 devstack sudo[115312]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info" returned: 0 in 0.250s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:00 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info is being set with open permissions: ugo+rw Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:00 devstack sudo[115315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info Aug 25 07:12:00 devstack sudo[115315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:00 devstack sudo[115315]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.info" returned: 0 in 0.245s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:00 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-339945ff-a515-422d-af20-d7ae9e5564eb tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-25eb8da8-04a8-4d1e-9d78-01b4aa2e2875-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-25eb8da8-04a8-4d1e-9d78-01b4aa2e2875-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-59ebc9a6-4cbe-4989-8033-9cad61d33307" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-59ebc9a6-4cbe-4989-8033-9cad61d33307" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot 25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 of volume 59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94fc513-4fed-4014-8bfe-68b763648dce]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:00 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:01 devstack sudo[115318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 Aug 25 07:12:01 devstack sudo[115318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:01 devstack sudo[115318]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" returned: 0 in 0.359s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:01 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ebc9a6-4cbe-4989-8033-9cad61d33307(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:12:01 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aeccda-9582-488b-9183-50232b86ae80]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:01 devstack sudo[115323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 Aug 25 07:12:01 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:01 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307" returned: 0 in 0.373s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:01 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:01 devstack sudo[115328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 Aug 25 07:12:01 devstack sudo[115328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:02 devstack sudo[115328]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" returned: 0 in 0.357s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:02 devstack sudo[115333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875 Aug 25 07:12:02 devstack sudo[115333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:02 devstack sudo[115333]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307.25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" returned: 0 in 0.254s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-25eb8da8-04a8-4d1e-9d78-01b4aa2e2875" released by "_delete_snapshot" :: held 1.431s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-59ebc9a6-4cbe-4989-8033-9cad61d33307" released by "delete_snapshot" :: held 1.452s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Created reservations ['b9c9254e-8743-42ad-83bd-f63c1c70ad78', '6596ac98-8f4b-40b3-aceb-4d3edfe88984', 'aaf4392c-30b5-4c56-acc4-ff06f49b59dd', '9972b185-9615-4599-afc0-884e58255f4b'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:02 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:12:02 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-80f48792-4330-4ba1-90e4-e2af9dfd5372 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-25eb8da8-04a8-4d1e-9d78-01b4aa2e2875-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-59ebc9a6-4cbe-4989-8033-9cad61d33307-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-59ebc9a6-4cbe-4989-8033-9cad61d33307-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-59ebc9a6-4cbe-4989-8033-9cad61d33307" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-59ebc9a6-4cbe-4989-8033-9cad61d33307" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7710c583-95ae-4014-94fe-385e0b434426]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:03 devstack sudo[115336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 Aug 25 07:12:03 devstack sudo[115336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:03 devstack sudo[115336]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307" returned: 0 in 0.366s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:03 devstack sudo[115341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307 Aug 25 07:12:03 devstack sudo[115341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:03 devstack sudo[115341]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-59ebc9a6-4cbe-4989-8033-9cad61d33307" returned: 0 in 0.259s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-59ebc9a6-4cbe-4989-8033-9cad61d33307" released by "delete_volume" :: held 0.681s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Created reservations ['80134406-0f0d-4a14-baab-86dcc5085c19', 'c9fc4031-65e0-4ae6-8f6a-bcee8db9ac8d', 'd764375f-b39d-45f6-a285-a8b42f9a5165', 'fafc5692-d974-4585-97c6-965c29e8c701'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:03 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:03 devstack sudo[115344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:12:03 devstack sudo[115344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:04 devstack sudo[115344]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.258s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:12:04 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-f876ebad-deae-49af-9340-c579307ed028 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-59ebc9a6-4cbe-4989-8033-9cad61d33307-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (25b4cbab-004e-459b-9aef-26c646f4169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79eddffa-742f-4e8c-9860-3e845548e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79eddffa-742f-4e8c-9860-3e845548e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071948649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40ccbdd-85f0-4160-b7fb-f1ee834506ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:12:05Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7bd5d2-465c-4fe8-9db2-f95bb2cde469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7bd5d2-465c-4fe8-9db2-f95bb2cde469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd21bfe-33ba-406e-a1e8-47fd251248fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd21bfe-33ba-406e-a1e8-47fd251248fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40ccbdd-85f0-4160-b7fb-f1ee834506ca', 'volume_name': 'volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c0bef4-e4a7-43b6-9bf3-cbcbd5c76e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c0bef4-e4a7-43b6-9bf3-cbcbd5c76e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07182c58-32ad-4055-8b6b-81918e85d248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:04 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Volume d40ccbdd-85f0-4160-b7fb-f1ee834506ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca', 'volume_size': 1} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071948649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40ccbdd-85f0-4160-b7fb-f1ee834506ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:12:05Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Creating volume d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:12:04 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:12:04 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:04 devstack sudo[115347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca 1073741824 Aug 25 07:12:04 devstack sudo[115347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:05 devstack sudo[115347]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca 1073741824" returned: 0 in 0.407s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:05 devstack sudo[115353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca Aug 25 07:12:05 devstack sudo[115353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:05 devstack sudo[115353]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07182c58-32ad-4055-8b6b-81918e85d248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a234aa1-2a8c-4f8b-80c7-4942359a9830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:05 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Volume volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca (d40ccbdd-85f0-4160-b7fb-f1ee834506ca): created successfully Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a234aa1-2a8c-4f8b-80c7-4942359a9830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (25b4cbab-004e-459b-9aef-26c646f4169d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:12:05 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c8bf5b8d-ed71-4aba-b728-f0f73b534373 tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot 8797e982-a5f8-4689-b7a1-a37cbc7f8880 of volume d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4708b39-3aa5-4a40-b1eb-d925b0a8f214]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:05 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:05 devstack sudo[115356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca Aug 25 07:12:05 devstack sudo[115356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:06 devstack sudo[115356]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" returned: 0 in 0.351s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:06 devstack sudo[115361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 1G Aug 25 07:12:06 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:06 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 1G" returned: 0 in 0.410s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:06 devstack sudo[115366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 Aug 25 07:12:06 devstack sudo[115366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:06 devstack sudo[115366]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880" returned: 0 in 0.285s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:06 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 is being set with open permissions: ugo+rw Aug 25 07:12:06 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:06 devstack sudo[115371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 Aug 25 07:12:06 devstack sudo[115371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:07 devstack sudo[115371]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:07 devstack sudo[115374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info Aug 25 07:12:07 devstack sudo[115374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:07 devstack sudo[115374]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:07 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info is being set with open permissions: ugo+rw Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:07 devstack sudo[115377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info Aug 25 07:12:07 devstack sudo[115377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:07 devstack sudo[115377]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.info" returned: 0 in 0.241s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:07 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-acc642a0-0869-48b6-a6b7-e171038426c6 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-8797e982-a5f8-4689-b7a1-a37cbc7f8880-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-8797e982-a5f8-4689-b7a1-a37cbc7f8880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-8797e982-a5f8-4689-b7a1-a37cbc7f8880" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-8797e982-a5f8-4689-b7a1-a37cbc7f8880" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:07 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot 8797e982-a5f8-4689-b7a1-a37cbc7f8880 of volume d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[710f5a2f-fa09-4de0-888b-00cab98b9dde]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:08 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 Aug 25 07:12:08 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:08 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880" returned: 0 in 0.360s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[73849b48-d42c-4459-b648-7316ee09d3a6]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:08 devstack sudo[115385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca Aug 25 07:12:08 devstack sudo[115385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:08 devstack sudo[115385]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" returned: 0 in 0.346s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:08 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:08 devstack sudo[115390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 Aug 25 07:12:08 devstack sudo[115390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:09 devstack sudo[115390]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880" returned: 0 in 0.337s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:09 devstack sudo[115396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880 Aug 25 07:12:09 devstack sudo[115396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:09 devstack sudo[115396]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca.8797e982-a5f8-4689-b7a1-a37cbc7f8880" returned: 0 in 0.250s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-8797e982-a5f8-4689-b7a1-a37cbc7f8880" released by "_delete_snapshot" :: held 1.382s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" released by "delete_snapshot" :: held 1.403s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Created reservations ['f621e36d-0903-44ed-8b9f-b4d04c5600a4', '4b8886c2-9247-4e29-af78-f426e141016a', '4eb0994d-e379-49d4-9afd-55dad0d8c2a6', '3e23765a-da67-4775-b409-cc90745fa8e7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:09 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:12:09 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eaed881f-d5d2-40df-b442-17804a63be2a tempest-ProjectMemberTests-1913535017 None] Lock "cinder-8797e982-a5f8-4689-b7a1-a37cbc7f8880-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-d40ccbdd-85f0-4160-b7fb-f1ee834506ca-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-d40ccbdd-85f0-4160-b7fb-f1ee834506ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7340f98-857e-47e4-aa45-dbee2b1dcabe]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:10 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca Aug 25 07:12:10 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:10 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" returned: 0 in 0.354s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:10 devstack sudo[115405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca Aug 25 07:12:10 devstack sudo[115405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:10 devstack sudo[115405]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" returned: 0 in 0.261s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-d40ccbdd-85f0-4160-b7fb-f1ee834506ca" released by "delete_volume" :: held 0.675s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Created reservations ['4d0a6d8a-9543-4006-8578-7110253e98ae', 'b009c7b0-4caf-4408-b1e1-d4e180cef0ce', 'd19090ca-31b9-46de-a42b-fc41085f7c4e', '3e911904-758e-4ff9-87f3-3ac5c4b29a58'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:10 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:10 devstack sudo[115408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:12:10 devstack sudo[115408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:11 devstack sudo[115408]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.246s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:12:11 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-eafdc888-934f-4974-bddf-526c18f2c1d8 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-d40ccbdd-85f0-4160-b7fb-f1ee834506ca-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (8741afee-f32f-48d2-9762-2c97050272de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b185c-aeec-40af-8748-29132e890571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b185c-aeec-40af-8748-29132e890571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649517925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30acf649-98c2-4453-9e16-a826ba7b8b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:12:12Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5e6ee0-eae3-4e02-a610-66bb7ee0051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5e6ee0-eae3-4e02-a610-66bb7ee0051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b299f257-2035-43ae-9f7f-8abed693ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b299f257-2035-43ae-9f7f-8abed693ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30acf649-98c2-4453-9e16-a826ba7b8b4d', 'volume_name': 'volume-30acf649-98c2-4453-9e16-a826ba7b8b4d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a07e12-b231-4929-9e93-6ae551a0d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a07e12-b231-4929-9e93-6ae551a0d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e4485b-8897-47e2-a441-b3983a7cd781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:11 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Volume 30acf649-98c2-4453-9e16-a826ba7b8b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30acf649-98c2-4453-9e16-a826ba7b8b4d', 'volume_size': 1} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649517925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30acf649-98c2-4453-9e16-a826ba7b8b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:12:12Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Creating volume 30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:12:11 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:12:11 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:11 devstack sudo[115411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d 1073741824 Aug 25 07:12:11 devstack sudo[115411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:12 devstack sudo[115411]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d 1073741824" returned: 0 in 0.440s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:12 devstack sudo[115416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d Aug 25 07:12:12 devstack sudo[115416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:12 devstack sudo[115416]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e4485b-8897-47e2-a441-b3983a7cd781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30acf649-98c2-4453-9e16-a826ba7b8b4d', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b77d8f-215f-41c1-b305-722cf1a99464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:12 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Volume volume-30acf649-98c2-4453-9e16-a826ba7b8b4d (30acf649-98c2-4453-9e16-a826ba7b8b4d): created successfully Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b77d8f-215f-41c1-b305-722cf1a99464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (8741afee-f32f-48d2-9762-2c97050272de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:12:12 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-89a8f262-8b58-41d4-8505-872b9f990518 tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot 4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 of volume 30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a112887-c487-4a33-ade5-2d0472e080b4]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:12 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:13 devstack sudo[115419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d Aug 25 07:12:13 devstack sudo[115419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:13 devstack sudo[115419]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d" returned: 0 in 0.369s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:13 devstack sudo[115424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 1G Aug 25 07:12:13 devstack sudo[115424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:13 devstack sudo[115424]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 1G" returned: 0 in 0.402s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30acf649-98c2-4453-9e16-a826ba7b8b4d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:13 devstack sudo[115429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30acf649-98c2-4453-9e16-a826ba7b8b4d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 Aug 25 07:12:13 devstack sudo[115429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:13 devstack sudo[115429]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30acf649-98c2-4453-9e16-a826ba7b8b4d -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" returned: 0 in 0.292s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:13 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 is being set with open permissions: ugo+rw Aug 25 07:12:13 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:13 devstack sudo[115434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 Aug 25 07:12:13 devstack sudo[115434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:14 devstack sudo[115434]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" returned: 0 in 0.249s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:14 devstack sudo[115437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info Aug 25 07:12:14 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:14 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info" returned: 0 in 0.268s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:14 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info is being set with open permissions: ugo+rw Aug 25 07:12:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:14 devstack sudo[115440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info Aug 25 07:12:14 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:14 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.info" returned: 0 in 0.255s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:14 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:14 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-b614d921-d35c-447c-9467-8f03fa9d8902 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-4f6b93f0-414d-43d0-b6b9-b7b0b3a02039-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-4f6b93f0-414d-43d0-b6b9-b7b0b3a02039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-30acf649-98c2-4453-9e16-a826ba7b8b4d" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-30acf649-98c2-4453-9e16-a826ba7b8b4d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot 4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 of volume 30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd2fe1-941f-4012-9fa1-1ccf9eea00bf]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:15 devstack sudo[115443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 Aug 25 07:12:15 devstack sudo[115443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:15 devstack sudo[115443]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" returned: 0 in 0.371s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30acf649-98c2-4453-9e16-a826ba7b8b4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[61043dd8-a9e7-44af-ac8e-7397d356ef97]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:15 devstack sudo[115448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d Aug 25 07:12:15 devstack sudo[115448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:15 devstack sudo[115448]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d" returned: 0 in 0.376s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:15 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:15 devstack sudo[115453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 Aug 25 07:12:15 devstack sudo[115453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:16 devstack sudo[115453]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" returned: 0 in 0.343s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:16 devstack sudo[115458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039 Aug 25 07:12:16 devstack sudo[115458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:16 devstack sudo[115458]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d.4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-4f6b93f0-414d-43d0-b6b9-b7b0b3a02039" released by "_delete_snapshot" :: held 1.435s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-30acf649-98c2-4453-9e16-a826ba7b8b4d" released by "delete_snapshot" :: held 1.457s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Created reservations ['235bcc40-e3b7-4ef5-bf07-e7e22458c76d', 'a67fc1be-efd6-4e05-8e66-6396c5652ecc', '28a122ff-a348-4bd1-9f2f-91db4dd02669', '826babdf-ac6d-437b-9c3d-52160bb553f7'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:16 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:12:16 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-9971efac-2642-490a-824a-68deadae51c9 tempest-ProjectMemberTests-1913535017 None] Lock "cinder-4f6b93f0-414d-43d0-b6b9-b7b0b3a02039-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-30acf649-98c2-4453-9e16-a826ba7b8b4d-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-30acf649-98c2-4453-9e16-a826ba7b8b4d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-30acf649-98c2-4453-9e16-a826ba7b8b4d" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-30acf649-98c2-4453-9e16-a826ba7b8b4d" acquired by "delete_volume" :: waited 0.015s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a881c1-869a-4c41-b9d6-e86de5044f76]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:17 devstack sudo[115461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d Aug 25 07:12:17 devstack sudo[115461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:17 devstack sudo[115461]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d" returned: 0 in 0.372s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:17 devstack sudo[115466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d Aug 25 07:12:17 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:17 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-30acf649-98c2-4453-9e16-a826ba7b8b4d" returned: 0 in 0.250s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-30acf649-98c2-4453-9e16-a826ba7b8b4d" released by "delete_volume" :: held 0.680s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:17 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Created reservations ['244d1061-3b9a-45d0-a34f-382a4190daba', 'b03099fe-9d64-4a8d-8cf7-638b483fa217', '44580a1c-5881-44f5-876a-b80fbaee8e15', 'f071d43f-c702-4aca-ad8f-0785ae66f8e1'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:18 devstack sudo[115469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:12:18 devstack sudo[115469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:18 devstack sudo[115469]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.262s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:12:18 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-df4fc3f9-5206-4440-a483-ea64e27e980f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-30acf649-98c2-4453-9e16-a826ba7b8b4d-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94460) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (8b603a6b-4292-4f2c-9c64-cf4348af8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a74b6eb-6981-4097-8bad-d4368b9a662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a74b6eb-6981-4097-8bad-d4368b9a662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535236208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97e8b27-c908-444b-bd5b-90ddfb4298fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:12:19Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73dc330-6e74-470c-b81e-3dfddc548e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73dc330-6e74-470c-b81e-3dfddc548e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a411918-947c-4da0-aab0-8f658f842616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a411918-947c-4da0-aab0-8f658f842616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97e8b27-c908-444b-bd5b-90ddfb4298fa', 'volume_name': 'volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7224070d-0483-42fc-9e92-5f7533ab1fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7224070d-0483-42fc-9e92-5f7533ab1fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4075bacc-3611-4468-b07a-e415fb843070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:18 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Volume e97e8b27-c908-444b-bd5b-90ddfb4298fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa', 'volume_size': 1} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T05:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535236208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97e8b27-c908-444b-bd5b-90ddfb4298fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee41483899740efab8643299def8ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T05:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T05:12:19Z,use_quota=True,user_id='93070f19200d476f9ce26185d7c63a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c04d1ae6-6297-42fb-9bdc-3df1593e3f03),volume_type_id=c04d1ae6-6297-42fb-9bdc-3df1593e3f03)}" {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Creating volume e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Selected osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b as target Quobyte volume. {{(pid=94460) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 25 07:12:18 devstack cinder-volume[94460]: INFO cinder.volume.drivers.remotefs [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] casted to osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b Aug 25 07:12:18 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa 1073741824 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:18 devstack sudo[115473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa 1073741824 Aug 25 07:12:18 devstack sudo[115473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:19 devstack sudo[115473]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa 1073741824" returned: 0 in 0.427s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:19 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa Aug 25 07:12:19 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:19 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa" returned: 0 in 0.248s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'} {{(pid=94460) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4075bacc-3611-4468-b07a-e415fb843070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa', 'volume_size': 1}' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1624a5-6b3f-4fc3-a286-4785426b96ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 25 07:12:19 devstack cinder-volume[94460]: INFO cinder.volume.flows.manager.create_volume [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Volume volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa (e97e8b27-c908-444b-bd5b-90ddfb4298fa): created successfully Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1624a5-6b3f-4fc3-a286-4785426b96ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94460) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Flow 'volume_create_manager' (8b603a6b-4292-4f2c-9c64-cf4348af8109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94460) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 25 07:12:19 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-d43d5278-10a8-4a5d-81ab-0d4291d01f28 tempest-ProjectMemberTests-1913535017 None] Created volume successfully. Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Creating offline snapshot 8457a39b-b60b-42e8-b126-a3d89d6bbf58 of volume e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3c80e-7873-43db-ae36-89a40a91db33]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:19 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:20 devstack sudo[115481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa Aug 25 07:12:20 devstack sudo[115481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:20 devstack sudo[115481]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa" returned: 0 in 0.385s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 1G {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:20 devstack sudo[115488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 1G Aug 25 07:12:20 devstack sudo[115488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:20 devstack sudo[115488]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 1G" returned: 0 in 0.413s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:20 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:20 devstack sudo[115494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 Aug 25 07:12:20 devstack sudo[115494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:21 devstack sudo[115494]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa -F qcow2 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58" returned: 0 in 0.304s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:21 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 is being set with open permissions: ugo+rw Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:21 devstack sudo[115499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 Aug 25 07:12:21 devstack sudo[115499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:21 devstack sudo[115499]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58" returned: 0 in 0.271s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:21 devstack sudo[115502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info Aug 25 07:12:21 devstack sudo[115502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:21 devstack sudo[115502]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info" returned: 0 in 0.263s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:21 devstack cinder-volume[94460]: WARNING cinder.volume.drivers.remotefs [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info is being set with open permissions: ugo+rw Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:21 devstack sudo[115505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info Aug 25 07:12:21 devstack sudo[115505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:21 devstack sudo[115505]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.info" returned: 0 in 0.262s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:21 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:21 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-1b7b8e77-6f80-4a35-8aa6-ad16709ee3c8 tempest-ProjectMemberTests-1913535017 None] Create snapshot completed successfully Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-8457a39b-b60b-42e8-b126-a3d89d6bbf58-delete_snapshot" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-8457a39b-b60b-42e8-b126-a3d89d6bbf58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-e97e8b27-c908-444b-bd5b-90ddfb4298fa" by "delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-e97e8b27-c908-444b-bd5b-90ddfb4298fa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-8457a39b-b60b-42e8-b126-a3d89d6bbf58" by "_delete_snapshot" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-8457a39b-b60b-42e8-b126-a3d89d6bbf58" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Deleting offline snapshot 8457a39b-b60b-42e8-b126-a3d89d6bbf58 of volume e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] snapshot_file for this snap is: volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 {{(pid=94460) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[2967093a-2781-46f5-bec5-8129c6d3b522]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:22 devstack sudo[115508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 Aug 25 07:12:22 devstack sudo[115508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:22 devstack sudo[115508]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58" returned: 0 in 0.353s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.remotefs [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94460) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[81656126-adaf-4729-b75a-e0a64cd65b5f]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:22 devstack sudo[115513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa Aug 25 07:12:22 devstack sudo[115513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:22 devstack sudo[115513]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa" returned: 0 in 0.362s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:22 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:23 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 Aug 25 07:12:23 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:23 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58" returned: 0 in 0.336s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:23 devstack sudo[115524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58 Aug 25 07:12:23 devstack sudo[115524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:23 devstack sudo[115524]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa.8457a39b-b60b-42e8-b126-a3d89d6bbf58" returned: 0 in 0.258s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-8457a39b-b60b-42e8-b126-a3d89d6bbf58" released by "_delete_snapshot" :: held 1.398s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-e97e8b27-c908-444b-bd5b-90ddfb4298fa" released by "delete_snapshot" :: held 1.420s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Created reservations ['cbd5b433-343b-4175-81db-dcf175a94c95', 'eddc6d16-d5e1-47e3-9cd9-4aecfe9a2bb7', 'c50709e3-ec01-48b9-bd1e-f6b7f1052afa', 'a42740d6-e814-40e7-a28f-7b5c873933f6'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:23 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Delete snapshot completed successfully. Aug 25 07:12:23 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-c88ca737-195a-481d-80de-97689d8a547f tempest-ProjectMemberTests-1913535017 None] Lock "cinder-8457a39b-b60b-42e8-b126-a3d89d6bbf58-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-e97e8b27-c908-444b-bd5b-90ddfb4298fa-delete_volume" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-e97e8b27-c908-444b-bd5b-90ddfb4298fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Acquiring lock "cinder-quobyte-e97e8b27-c908-444b-bd5b-90ddfb4298fa" by "delete_volume" {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-e97e8b27-c908-444b-bd5b-90ddfb4298fa" acquired by "delete_volume" :: waited 0.014s {{(pid=94460) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG oslo.privsep.daemon [-] privsep: reply[4945d41c-996a-472b-b560-5e425563fa15]: (4, 'qcow2') {{(pid=95707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:24 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa Aug 25 07:12:24 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:24 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa" returned: 0 in 0.366s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:24 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:24 devstack sudo[115546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa Aug 25 07:12:24 devstack sudo[115546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:25 devstack sudo[115546]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f/volume-e97e8b27-c908-444b-bd5b-90ddfb4298fa" returned: 0 in 0.251s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-quobyte-e97e8b27-c908-444b-bd5b-90ddfb4298fa" released by "delete_volume" :: held 0.676s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG cinder.quota [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Created reservations ['9b5ea5eb-f221-475a-b759-14bb5483878b', 'fefa4aa5-dd33-4855-82e3-92bde9deb321', '6e28439d-153f-4138-a2d8-d31b2b599269', '7eb0c5b8-4a0b-4890-9ee5-d84a0e707024'] {{(pid=94460) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:25 devstack sudo[115571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:12:25 devstack sudo[115571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:25 devstack sudo[115571]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.265s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:12:25 devstack cinder-volume[94460]: INFO cinder.volume.manager [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Deleted volume successfully. Aug 25 07:12:25 devstack cinder-volume[94460]: DEBUG cinder.coordination [None req-e55fd210-5ec1-489d-beaa-db0a85c61a5c tempest-ProjectMemberTests-1913535017 None] Lock "cinder-e97e8b27-c908-444b-bd5b-90ddfb4298fa-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=94460) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b': None} {{(pid=94460) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG cinder.volume.drivers.quobyte [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3ccf687-8ddb-47bb-83a8-cc770346864b'] {{(pid=94460) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.lockutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94460) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 25 07:12:31 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 07:12:31 devstack sudo[115580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f Aug 25 07:12:31 devstack sudo[115580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 07:12:32 devstack sudo[115580]: pam_unix(sudo:session): session closed for user root Aug 25 07:12:32 devstack cinder-volume[94460]: DEBUG oslo_concurrency.processutils [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bd69b9624270a704f6d53a12032b24f" returned: 0 in 0.242s {{(pid=94460) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 07:12:32 devstack cinder-volume[94460]: DEBUG cinder.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Notifying Schedulers of capabilities ... {{(pid=94460) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 07:12:32 devstack cinder-volume[94460]: DEBUG oslo_service.periodic_task [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] Running periodic task VolumeManager._thread_info {{(pid=94460) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 25 07:12:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread count: 29 {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5601}} Aug 25 07:12:32 devstack cinder-volume[94460]: DEBUG cinder.volume.manager [None req-80b72088-53f9-4a0a-877f-71d3e5c8cc66 None None] thread info: [<_MainThread(MainThread, started 126857004437632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94460) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5602}} Aug 25 07:12:35 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:UPDATE=107,cinder:SELECT=73,cinder:INSERT=23,cinder:DELETE=8 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 25 07:12:35 devstack cinder-volume[94460]: DEBUG dbcounter [-] [94460] Writing DB stats cinder:INSERT=34,cinder:UPDATE=104,cinder:SELECT=80,cinder:DELETE=9 {{(pid=94460) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}